Image Processing Apparatus And Robot System

ABSTRACT

An image processing apparatus includes a first connecting unit connected to an image pickup apparatus, a plurality of second connecting units connected to one control apparatus or one other image processing apparatus, the control apparatus being configured to control a robot; and a processing unit configured to process picked-up images picked up by the image pickup apparatus.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a divisional of U.S. patent application Ser. No.14/854,499, filed Sep. 15, 2015, which claims priority to JapanesePatent Application No. 2014-188035, filed Sep. 16, 2014; Japanese PatentApplication No. 2014-188127, filed Sep. 16, 2014; Japanese PatentApplication No. 2014-187732, filed Sep. 16, 2014; Japanese PatentApplication No. 2014-188036, filed Sep. 16, 2014; Japanese PatentApplication No. 2014-188037, filed Sep. 16, 2014; and Japanese PatentApplication No. 2014-188038, filed Sep. 16, 2014, all of which arehereby expressly incorporated by reference herein in their entireties.

BACKGROUND 1. Technical Field

The present invention relates to an image processing apparatus and arobot system.

2. Related Art

There has been proposed a robot system that calculates a position and aposture of a work target using an image picked up by an image pickupapparatus and causes a robot to perform predetermined work on the basisof the calculated position and the calculated posture.

The robot system includes the image pickup apparatus, an imageprocessing apparatus, a robot controller, and a robot. The imageprocessing apparatus calculates a center position of the work targetusing the image picked up by the image pickup apparatus. The robotcontroller recognizes the position and the posture of the work target onthe basis of information indicating the center position of the worktarget calculated by the image processing apparatus. The robotcontroller generates, on the basis of recognized positions and posturesof work targets, a command for positioning a hand mechanism of the robotin an appropriate position and an appropriate posture and controls agripping action of the robot. In the robot system, the image pickupapparatus is connected to the image processing apparatus, the robotcontroller is connected to the image processing apparatus, and the robotis connected to the robot controller (see, for example, JP-A-2012-242281(Patent Literature 1)).

The image processing apparatus in the past includes one LAN (Local AreaNetwork) port for connection to the robot controller. The imageprocessing apparatus and the robot controller are connected to eachother, for example, by a LAN cable.

In recent years, in a site where a robot is used, for example, there isa demand that a plurality of image processing apparatuses are to onerobot controller to control the robot. Alternatively, in a site where arobot is used, there is a demand that a plurality of robot controllersshare and use one image processing apparatus.

In the robot system in the past, the image pickup apparatus is connectedto the image processing apparatus via a USB (Universal Serial Bus) or aLAN cable.

When the image pickup apparatus and the image processing apparatus areconnected via the LAN cable, a user performs setting concerning anetwork for the image pickup apparatus. Alternatively, in the robotsystem in the past, a DHCP (Dynamic Host Configuration Protocol) serveris provided in the network to automatically perform setting concerning anetwork for the image pickup apparatus.

There has been researched and developed a method of calculating aposition and a posture of a work target on the basis of a picked-upimage picked up by an image pickup unit and causing a robot to performpredetermined work on the basis of the calculated position and thecalculated posture.

Concerning the method, there is known an image processing apparatusconnected to a control apparatus that controls the robot and separatefrom a control apparatus that performs image processing such ascalculation of the position and the posture of the work target based onthe picked-up image (seehttp://robots.epson.com/admin/uploads/product_catalog/files/EPSON_CV1_Vision%20(RevB).pdf“Vision Guidance for Epson Robots” (Non Patent Literature 1).

There has been proposed a robot system that controls the operation of arobot using a picked-up image picked up by an image pickup apparatus.For example, JP-A-2009-218933 (Patent Literature 2) describes a robotsystem in which an image processing apparatus, a control apparatus, anda PC (Personal Computer) for control are connected via a network. Theimage processing apparatus processes a picked-up image around the robotacquired from the image pickup apparatus. The PC for control functionsas a development environment for displaying the picked-up image acquiredfrom the image pickup apparatus and creating a computer program forimage processing.

For the image processing apparatus to apply the image processing to thepicked-up image, physical connection of the image pickup apparatus tothe image processing apparatus is not enough. Setting for the PC forcontrol is necessary. For example, a user checks beforehand an IP(Internet Protocol) address of the image processing apparatus andperforms operation for manually inputting the checked IP address to thePC for control. A plurality of image pickup apparatuses are connectableto the image processing apparatus. There is an image processingapparatus capable of using a plurality of models of image pickupapparatuses. Concerning such an image processing apparatus, a userchecks in advance a camera of which model is connected to the imageprocessing apparatus and performs operation for setting, in the PC forcontrol, which of a plurality of cameras is selected. When the PC forcontrol and the image processing apparatus are connected to the samenetwork segment, the PC for control and the image processing apparatuscan transmit and receive data immediately after the completion of thesetting operation. Therefore, it is possible to use the image pickupapparatus for which the setting is completed. The network segment is alogically divided range of a LAN and is sometimes called sub-network.

However, the image processing apparatus in the past includes only oneLAN port. Therefore, for example, when a plurality of image processingapparatuses are connected to one robot controller to control the robot,it is necessary to connect the robot controller and the plurality ofimage processing apparatuses via a network switch (a switching hub) andperform communication among the apparatuses.

In the image processing apparatus in the past, the DHCP server isnecessary to automatically performing the setting concerning a networkfor the image pickup apparatus. When the DHCP server is not used, theuser needs to manually perform the setting concerning a network for theimage pickup apparatus. In this case, the user needs to grasp settingcontents of the image processing apparatus and the robot controller,which are connected to the robot system, concerning a network.

In the image processing apparatus in the past, when a serious error thatcannot be solved by operation by a person not having special knowledge(e.g., the user) occurs, for example, some trouble is caused by executedprocessing and, thereafter, the image processing apparatus cannot bestarted, the user has to disassemble the image processing apparatus toremove a storing unit included in the image processing apparatus, sendthe storing unit to a person having special knowledge (e.g., atechnician of a manufacturer), and ask the person to repair the storingunit. Therefore, the user consumes time and labor.

When the PC for control and the image processing apparatus are connectedto different network segments, the PC for control and the imageprocessing apparatus cannot transmit and receive data even if thesetting operation is completed. Therefore, the image pickup apparatusfor which the setting is completed cannot be used unless the setting ofthe network segment of one of the PC for control and the imageprocessing apparatus is adjusted to the setting of the network segmentof the other. In particular, in a large robot system including aplurality of image processing apparatuses, the user consumes a lot oflabor for the setting operation.

Even in a state in which some abnormality occurs in hardware of theimage processing apparatus, the control apparatus in the past cannotdetect the state.

The image processing apparatus in the past does not take into accountthat a person not having special knowledge (e.g., a user) is caused toupdate an OS (Operating System). When the user has to update the OS, theuser has to disassemble the image processing apparatus, send the imageprocessing apparatus to a person having special knowledge (e.g., atechnician of a manufacture), and ask the person to update the OS.Therefore, the user needs to consume time and labor.

SUMMARY

An advantage of some aspects of the invention is to solve at least apart of the problems described above, and the invention can beimplemented as the following aspects or application examples.

An aspect of the invention is directed to an image processing apparatusincluding: a first connecting unit connected to an image pickupapparatus; a plurality of second connecting units connected to one ormore control apparatuses that control a robot or one or more other imageprocessing apparatuses; and a processing unit configured to processpicked-up images picked up by the image pickup apparatuses.

With this configuration, the image processing apparatus includes theplurality of second connecting units. Consequently, in the imageprocessing apparatus, it is possible to connect external apparatusesrespectively to the plurality of second connecting units without using anetwork switch.

In the aspect of the invention, each of the plurality of secondconnecting units may include a different identifier. The processing unitmay be capable of setting the same IP address in at least two or more ofthe plurality of second connecting units.

With this configuration, the image processing apparatus can set the sameIP address in at least two or more second connecting units.Consequently, in the image processing apparatus, a user can easilyperform connection to a plurality of external apparatuses without beingaware of the IP address.

In the aspect of the invention, the processing unit may be capable ofsetting an IP address different from the same IP address in the secondconnecting units other than the second connecting units in which thesame IP address is set.

With this configuration, the image processing apparatus can set anotherIP address in the second connecting units other than the secondconnecting units in which the same IP address is set. Consequently, theimage processing apparatus can perform connection to a plurality ofexternal apparatuses using different IP addresses without using anetwork switch.

In the aspect of the invention, the same IP address may be informationinput from an information processing apparatus that outputs a controlprogram for the robot to the control apparatus or information input froma setting screen on which an IP address can be set.

With the configuration, the same IP address can be input to the imageprocessing apparatus from the control apparatus or the setting screen onwhich an IP address can be set. Consequently, in the image processingapparatus, the IP address can be set from both of the control apparatusand the setting screen.

Another aspect of the invention is directed to a robot system including:the image processing apparatus according to the aspect of the invention;a robot main body unit; the image pickup apparatus; and the controlapparatus configured to perform driving control of the robot main bodyunit.

With this configuration, in the robot system, the image processingapparatus includes the plurality of second connecting units.Consequently, in the robot system, it is possible to connect the imageprocessing apparatus and a plurality of external apparatuses and controlthe robot system without using a network switch.

According to the aspects of the invention, the image processingapparatus includes the plurality of second connecting units. Therefore,it is possible to connect an external apparatus to the image processingapparatus without using a network switch. As a result, according to theaspects of the invention, the image processing apparatus can communicatewith a plurality of external apparatuses without using a network switch.

Still another aspect of the invention is directed to an image processingapparatus including: a connecting unit connected to an image pickupapparatus; a determining unit configured to determine, using settinginformation of the image pickup apparatus and setting information of theconnecting unit, whether it is necessary to change the settinginformation of the image pickup apparatus; and a changing unitconfigured to change the setting information of the image pickupapparatus when the determining unit determines that it is necessary tochange the setting information of the image pickup apparatus.

With this configuration, the image processing apparatus can change thesetting information of the image pickup apparatus when it is determinedusing the setting information of the image pickup apparatus and thesetting information of the connecting unit that it is necessary tochange the setting information of the image pickup apparatus.Consequently, in the image processing apparatus, it is possible toautomatically perform setting concerning a network for the image pickupapparatus.

In the aspect of the invention, the setting information of the imagepickup apparatus and the setting information of the connecting unit maybe respectively setting information concerning a network and includenetwork segment information indicating a network segment and an IPaddress including the network segment information. The determining unitmay compare the network segment information included in the settinginformation of the image pickup apparatus and the network segmentinformation included in the setting information of the connecting unit,when these kinds of network segment information coincide with eachother, compare the IP address included in the setting information of theimage pickup apparatus and the IP address included in the settinginformation of the connecting unit, and, when the IP addresses coincidewith each other, determine that it is necessary to change a fourthsegment of the IP address included in the setting information of theimage pickup apparatus.

With this configuration, the image processing apparatus can change thefourth segment of the IP address of the image pickup apparatus when thenetwork segment of the connecting unit and the network segment of theimage pickup apparatus coincide with each other and the IP address ofthe connecting unit and the IP address of the image pickup apparatuscoincide with each other. Consequently, in the image processingapparatus, even when the IP addresses of the connecting unit and theimage pickup apparatus coincide with each other, it is possible toautomatically perform setting concerning a network for the image pickupapparatus.

In the aspect of the invention, when the network segment informationincluded in the setting information of the image pickup apparatus andthe network segment information included in the setting information ofthe connecting unit do not coincide with each other, the determiningunit may determine that it is necessary to change the network segmentinformation of the IP addresses to coincide and change the fourthsegment to be different in the setting information of the image pickupapparatus and the setting information of the connecting unit.

With this configuration, when the network segment of the connecting unitand the network segment of the image pickup apparatus do not coincidewith each other, the image processing apparatus can change the IPaddress of the image pickup apparatus to coincide with the networksegment of the connecting unit and change the fourth segment to bedifferent. Consequently, in the image processing apparatus, even whenthe network segments of the connecting unit and the image pickupapparatus coincide with each other, it is possible to automaticallyperform setting concerning a network for the image pickup apparatus.

In the aspect of the invention, the image processing apparatus mayfurther include an external-communication connecting unit connected to acontrol apparatus that controls a robot or other image processingapparatuses. The determining unit may determine, using settinginformation of the external-communication connecting unit, whether it isnecessary to change the setting information of the image pickupapparatus.

With this configuration, the image processing apparatus can change thesetting information of the image pickup apparatus when it is determinedusing the setting information of the external-communication connectingunit and the setting information of the connecting unit that it isnecessary to change the setting information of the image pickupapparatus. Consequently, in the image processing apparatus, it ispossible to automatically perform setting concerning a network for theimage pickup apparatus.

In the aspect of the invention, the setting information of the imagepickup apparatus and the setting information of theexternal-communication connecting unit may be respectively settinginformation concerning a network and include network segment informationindicating a network segment and an IP address including the networksegment information. The determining unit may compare the networksegment information included in the setting information of the imagepickup apparatus and the network segment information included in thesetting information of the external-communication connecting unit and,when these kinds of network segment information coincide with eachother, determine that it is necessary to change the network segmentinformation of the IP address included in the setting information of theimage pickup apparatus.

With this configuration, the image processing apparatus can change thenetwork segment of the image pickup apparatus when the network segmentof the connecting unit and the network segment of theexternal-communication connecting unit coincide with each other.Consequently, in the image processing apparatus, when the IP address ofthe external-communication connecting unit is changed, even when thenetwork segments of the external-communication connecting unit and theimage pickup apparatus coincide with each other, it is possible toautomatically perform setting concerning a network for the image pickupapparatus.

Yet another aspect of the invention is directed to a robot systemincluding: the image processing apparatus according to the aspect of theinvention; a robot main body unit; and a robot control apparatusconfigured to perform communication using the setting informationchanged by the changing unit of the image processing apparatus andperform driving control of the robot main body unit.

With this configuration, in the robot system, the image processingapparatus can change the setting information of the image pickupapparatus when it is determined using the setting information of theimage pickup apparatus and the setting information of the connectingunit that it is necessary to change the setting information of the imagepickup apparatus. Consequently, the robot system can control the robotusing a result of the image processing apparatus automaticallyperforming setting concerning a network for the image pickup apparatus.

According to the aspects of the invention, the image processingapparatus determines, using the network setting information of the imagepickup apparatus and the network setting information of the connectingunit to which the image pickup apparatus is connected or theexternal-communication connecting unit to which another apparatus isconnected, whether it is necessary to change the network settinginformation of the image pickup apparatus and, when it is necessary tochange the network setting information of the image pickup apparatus,changes the network setting information of the image pickup apparatus.Therefore, it is possible to automatically perform setting concerning anetwork for the image pickup apparatus.

Still yet another aspect of the invention is directed to an imageprocessing apparatus including: a processing unit configured to processa picked-up image picked up by an image pickup apparatus; and a storingunit configured to store data concerning the image processing apparatus.When a reset signal is input, the processing unit deletes at least apart of the data stored in the storing unit.

With this configuration, when the reset signal is input, the imageprocessing apparatus deletes at least a part of the data concerning theimage processing apparatus stored in the storing unit. Consequently, itis possible to easily restore the image processing apparatus to apredetermined state.

In the aspect of the invention, in the image processing apparatus, thedata stored in the storing unit may include history information ofhardware monitoring of the image processing apparatus, informationrelated to processing performed by the processing unit, and a systemlog.

With this configuration, when the reset signal is input, the imageprocessing apparatus deletes at least a part of the history informationof the hardware monitoring of the image processing apparatus stored inthe storing unit, the information related to the processing performed bythe processing unit, and the system log. Consequently, it is possible torestore the image processing apparatus to a predetermined state based ona part or all of the history information of the hardware monitoring ofthe image processing apparatus, the information related to theprocessing performed by the processing unit, and the system log.

In the aspect of the invention, in the image processing apparatus, whena data saving signal is input, the processing unit may store, in anexternal storage device, at least a part of the data stored in thestoring unit.

With this configuration, when the data saving signal is input, the imageprocessing apparatus stores, in the external storage device, at least apart of the data concerning the image processing apparatus stored in thestoring unit. Consequently, the image processing apparatus can cause theuser to check a state of the image processing apparatus on the basis ofthe data concerning the image processing apparatus stored in theexternal storage device.

In the aspect of the invention, the image processing apparatus mayfurther include: an input receiving unit including one or more buttons;and an input determining unit configured to input the data saving signalto the processing unit when a predetermined button among the one or morebuttons included in the input receiving unit is released before apredetermined time elapses from depression of the predetermined buttonand input the reset signal to the processing unit when the predeterminedbutton is released after the predetermined time or more elapses from thedepression of the predetermined button.

With this configuration, the image processing apparatus inputs the datasaving signal to the processing unit when the predetermined button amongthe one or more buttons included in the input receiving unit is releasedbefore the predetermined time elapses from the depression of thepredetermined button and inputs the reset signal to the processing unitwhen the predetermined button is released after the predetermined timeor more elapses from the depression of the predetermined button.Consequently, the image processing apparatus can select, according totime from the depression until the release of the predetermined button,processing performed by the processing unit.

In the aspect of the invention, the image processing apparatus mayfurther include an output control unit configured to change an outputstate of the output unit for time determined in advance when thepredetermined button continues to be depressed for the predeterminedtime or more.

With this configuration, the image processing apparatus changes theoutput state of the output unit for the time determined in advance whenthe predetermined button continues to be pressed for the predeterminedtime or more. Consequently, the image processing apparatus can notifythe user whether the predetermined button continues to be depressed forthe predetermined time or more.

In the aspect of the invention, in the image processing apparatus, theoutput control unit may change the output state of the output unitaccording to success or failure of the deletion of at least part of thedata by the processing unit or the storage in the external storagedevice of at least part of the data by the processing unit.

With this configuration, the image processing apparatus changes theoutput state of the output unit according to success or failure of thedeletion of at least part of the data concerning the image processingapparatus by the processing unit or the storage in the external storagedevice of at least part of the data concerning the image processingapparatus by the processing unit. Consequently, the image processingapparatus can notify the user of success or failure of the deletion ofat least part of the data concerning the image processing apparatus bythe processing unit or the storage in the external storage device of atleast a part of the data concerning the image processing apparatus bythe processing unit.

In the aspect of the invention, in the image processing apparatus, whenthe external storage device is not connected to the image processingapparatus, the processing unit may not store at least a part of the datain the external storage device even when the data saving signal isinput.

With this configuration, when the external storage device is notconnected to the image processing apparatus, the image processingapparatus does not store at least a part of the data in the externalstorage device even when the data saving signal is input. Consequently,the image processing apparatus can suppress continuation of processingof the processing unit by wrong operation in a state in whichpreparation for storing at least a part of the data concerning the imageprocessing apparatus in the external storage device is not completed.

Further another aspect of the invention is directed to a robot systemincluding: a robot configured to perform predetermined work; an imagepickup apparatus configured to pick up an image of a range related tothe predetermined work; an image processing apparatus configured toprocess the picked-up image picked up by the image pickup apparatus; anda control apparatus configured to control the robot on the basis of aresult of the processing by the image processing apparatus. The imageprocessing apparatus includes: a processing unit configured to processthe picked-up image picked up by the image pickup apparatus; and astoring unit configured to store data concerning the image processingapparatus. When a reset signal is input, the processing unit deletes atleast a part of the data stored in the storing unit.

With this configuration, when the reset signal is input, the robotsystem deletes at least a part of the data stored in the storing unit.Consequently, it is possible to easily restore the robot system to apredetermined state.

As explained above, when the reset signal is input, the image processingapparatus and the robot system delete at least a part of the data storedin the storing unit. Consequently, it is possible to easily restore theimage processing apparatus and the robot system to predetermined states.

Still further another aspect of the invention is directed to an imageprocessing system including: an image processing apparatus configured toprocess a picked-up image; and a display apparatus configured to displaya screen on which setting of the image processing apparatus isperformed. The image processing apparatus searches for image pickupapparatuses communicable with the image processing apparatus. Thedisplay apparatus displays information concerning the communicable imagepickup apparatuses found by the image processing apparatus.

With this configuration, the information concerning the communicableimage pickup apparatuses found by the image processing apparatus isdisplayed. Therefore, it is possible to select, from the displayed imagepickup apparatuses, an image pickup apparatus that the user desires touse. Therefore, in the setting of the image processing apparatus, it isunnecessary to check in advance information concerning an image pickupapparatus that the user desires to use.

In the aspect of the invention, in the image processing system, thedisplay apparatus may broadcast, to a network connected to the displayapparatus, a search packet including a command for inquiring aboutinformation set in an apparatus at a transmission destination. Whenreceiving the search packet from the display apparatus, the imageprocessing apparatus may broadcast, to the network, a search responsepacket including information concerning the found communicable imagepickup apparatuses.

With this configuration, even when the image processing apparatus towhich the image pickup apparatus is connected belongs to a sub-networkdifferent from a sub-network to which the display apparatus belongs, thedisplay apparatus can acquire information concerning the image pickupapparatus connected to the image processing apparatus. Therefore, theuser can obtain a clue for using, without omission, the image pickupapparatuses found by the image processing apparatus connected to thenetwork.

In the aspect of the invention, in the image processing system, anetwork address of the image processing apparatus may be included in thesearch response packet. The display apparatus may display the networkaddress in association with information concerning the image pickupapparatus.

With this configuration, a network address of an image processingaddress related to the image pickup apparatus that the user desires touse is displayed. Therefore, in setting for using the image pickupapparatus, the user can recognize the network address of the imageprocessing apparatus.

In the aspect of the invention, in the image processing system, thedisplay apparatus may acquire a new network address and broadcast achange packet including the acquired network address to a networkconnected to the display apparatus. The image processing apparatus maychange a network address set in the image processing apparatus to thenetwork address included in the change packet received from the displayapparatus.

With this configuration, even when the image processing apparatusconnected to the image pickup apparatus belongs to a sub-networkdifferent from a sub-network to which the display apparatus belongs, itis possible to change the network address set in the image processingapparatus to the network address acquired by the display apparatus. Forexample, by setting, in the display apparatus, an unused network addressbelonging to a sub-network same as the sub-network to which the displayapparatus belongs, it is possible to cause the image processingapparatus to belong to the sub-network same as the sub-network to whichthe display apparatus belongs.

In the aspect of the invention, in the image processing system, thedisplay apparatus may belong to the sub-network same as the sub-networkto which the display apparatus belongs and decide the unused networkaddress as a network address of the image processing apparatus.

With this configuration, the user can cause the image processingapparatus to belong to the sub-network same as the sub-network to whichthe display apparatus belongs without checking a network address inadvance and inputting the network address. Consequently, it is possibleto perform communication between the display apparatus and the imagepickup apparatus connected to the image processing apparatus.

In the aspect of the invention, in the image processing system, when theimage processing apparatus belongs to the sub-network same as thesub-network to which the display apparatus belongs, the image processingapparatus may include the network address of the display apparatus inthe search response packet as a network address of a transmissiondestination.

With this configuration, by broadcasting the search response packet, itis possible to avoid useless communication in which the search responsepacket is transmitted to apparatuses other than the display apparatus.

Yet further another aspect of the invention is directed to a robotsystem including: a robot; an image processing apparatus configured toprocess a picked-up image; a display apparatus configured to display ascreen for performing setting of the image processing apparatus; and acontrol apparatus configured to control the operation of the robot onthe basis of a processing result of the image processing apparatus. Theimage processing apparatus searches for image pickup apparatusescommunicable with the image processing apparatus. The display apparatusdisplays information concerning the communicable image pickupapparatuses found by the image processing apparatus.

With this configuration, the information concerning the communicableimage pickup apparatuses found by the image processing apparatus isdisplayed. Therefore, the user can select, from the displayed imagepickup apparatuses, an image pickup apparatus that the user desires touse. Therefore, in setting of the image pickup apparatus, it isunnecessary to check in advance information concerning the image pickupapparatus that the user desires to use.

According to the aspects of the invention explained above, it ispossible to easily perform setting concerning the image pickupapparatus.

Still yet further another aspect of the invention is directed to acontroller including: a receiving unit configured to receive, from animage processing apparatus that processes a picked-up image, stateinformation of the image processing apparatus; a determining unitconfigured to determine a state of the image processing apparatus on thebasis of the state information; and a generating unit configured togenerate, on the basis of a determination result by the determiningunit, a transmission signal to be transmitted to an external apparatus.

With this configuration, the controller receives, from the imageprocessing apparatus that processes a picked-up image, state informationof the image processing apparatus, determines a state of the imageprocessing apparatus on the basis of the state information, andgenerates, on the basis of a result of the determination, a transmissionsignal to be transmitted to the external apparatus. Consequently, it ispossible to notify a state of the image processing apparatus.

In the aspect of the invention, in the controller, the determining unitmay determine, as the state of the image processing apparatus, any oneof a normal state, a state in which the image processing apparatus ishighly likely be out of order, and a state in which the image processingapparatus is highly likely to fail in future.

With this configuration, the controller determines, as the state of theimage processing apparatus, any one of the normal state, the state inwhich the image processing apparatus is highly likely to be out oforder, and the state in which the image processing apparatus is highlylikely to fail in future. Consequently, the controller makes it possibleto notify, as the state of the image processing apparatus, any one ofthe normal state, the state in which the image processing apparatus ishighly likely to be out of order, and the state in which the imageprocessing apparatus is highly likely to fail in future.

In the aspect of the invention, in the controller, the state informationmay include information indicating one or more physical quantitiesindicating states of hardware included in the image processingapparatus. The controller may further include an event detecting unitconfigured to detect, on the basis of the one or more physicalquantities, an event including abnormality of the image processingapparatus. The determining unit may determine the state of the imageprocessing apparatus on the basis of the event detected by the statedetecting unit.

With this configuration, the controller detects an event indicatingabnormality of the image processing apparatus on the basis of the one ormore physical quantities indicating the states of hardware included inthe image processing apparatus and determine the state of the imageprocessing apparatus on the basis of the detected event. Consequently,the controller can generate a transmission signal based on the state ofthe image processing apparatus determined on the basis of the eventindicating the abnormality of the image processing apparatus.

In the aspect of the invention, in the controller, the state informationmay include an error code related to control of the image processingapparatus. The event detecting unit may detect an event indicatingabnormality of the image processing apparatus on the basis of an errorcode related to control of the image processing apparatus.

With this configuration, the controller detects an event indicatingabnormality of the image processing apparatus on the basis of the errorcode related to the control of the image processing apparatus.Consequently, the controller can generate, as the state of the imageprocessing apparatus, a transmission signal based on the state of theimage processing apparatus determined on the basis of the eventindicating the abnormality of the image processing apparatus detected onthe basis of the error code related to the control of the imageprocessing apparatus.

In the aspect of the invention, in the controller, the determining unitmay associate information for identifying the state of the imageprocessing apparatus with the state of image processing apparatusdetermined on the basis of the event. The generating unit may include,in the transmission signal, the information for identifying the state ofthe image processing apparatus associated by the determining unit.

With this configuration, the controller associates the information foridentifying the state of the image processing apparatus with the stateof image processing apparatus determined on the basis of the eventindicating the abnormality of the image processing apparatus andincludes, in the transmission signal, the associated information foridentifying the state of the image processing apparatus. Consequently,the controller can generate the transmission signal including theinformation for identifying the state of the image processing apparatus.

In the aspect of the invention, the controller may further include acommunication control unit configured to cause a communication unit totransmit the transmission signal generated by the generating unit to theexternal apparatus.

With this configuration, the controller causes the communication unit totransmit the transmission signal generated on the basis of thedetermination result of the state of the image processing apparatus tothe external apparatus. Consequently, the controller can notify a userof the external apparatus of the state of the image processingapparatus.

In the aspect of the invention, in the controller, the communicationcontrol unit may cause, according to a request from the externalapparatus, the communication unit to transmit the information indicatingthe one or more physical quantities to the external apparatus.

With this configuration, the controller causes, according to a requestfrom the external apparatus, the communication unit to transmit theinformation indicating one or more physical quantities indicating thestates of the hardware included in the image processing apparatus to theexternal apparatus. Consequently, the controller can notify the user ofthe one or more physical quantities indicating the states of thehardware included in the image processing apparatus.

In the aspect of the invention, in the controller, the communicationcontrol unit may cause, according to the determination result by thedetermining unit, the communication unit to transmit information forrequesting a change of the output state of the output unit included inthe image processing apparatus to the image processing apparatus.

With this configuration, the controller causes, according to thedetermination result of the state of the image processing apparatus, thecommunication unit to transmit the information for requesting a changeof the output state of the output unit included in the image processingapparatus to the image processing apparatus. Consequently, thecontroller can cause, with the image processing apparatus, the user tocheck the state of the image processing apparatus.

A further aspect of the invention is directed to an informationprocessing apparatus that displays a GUI (Graphical User Interface) fordisplaying the one or more physical quantities acquired from thecontroller.

With this configuration, the information processing apparatus displaysthe GUI for displaying the one or more physical quantities indicatingthe states of the hardware included in the image processing apparatusacquired from the controller. Consequently, the information processingapparatus can facilitate management of the state of the image processingapparatus by providing the user with the GUI for displaying the one ormore physical quantities indicating the states of the hardware includedin the image processing apparatus.

A still further aspect of the invention is directed to a robot systemincluding: a robot configured to perform predetermined work; an imagepickup apparatus configured to pick up an image of a range related tothe predetermined work; an image processing apparatus configured toprocess the picked-up image picked up by the image pickup apparatus; anda controller configured to control the robot on the basis of a result ofthe processing by the image processing apparatus. The controllerincludes: a receiving unit configured to receive state information ofthe image processing apparatus from the image processing apparatus; adetermining unit configured to determine a state of the image processingapparatus on the basis of the state information; and a generating unitconfigured to generate, on the basis of a determination result by thedetermining unit, a transmission signal to be transmitted to theexternal apparatus.

With this configuration, the processing system receives the stateinformation of the image processing apparatus from the image processingapparatus, determines the state of the image processing apparatus on thebasis of the state information, and generates, on the basis of a resultof the determination, the transmission signal to be transmitted to theexternal apparatus. Consequently, the robot system enables notificationof the state of the image processing apparatus.

As explained above, the controller and the robot system receive thestate information of the image processing apparatus from the imageprocessing apparatus, determine the state of the image processingapparatus on the basis of the state information, and generate, on thebasis of a result of the determination, the transmission signal to betransmitted to the external apparatus. Consequently, the controller andthe robot system enable notification of the state of the imageprocessing apparatus.

The information processing apparatus displays a GUI for displaying theone or more physical quantities indicating the states of the hardwareincluded in the image processing apparatus acquired from the controller.Consequently, the information processing apparatus can facilitatemanagement of the state of the image processing apparatus by providing auser with the GUI for displaying the one or more physical quantitiesindicating the states of the hardware included in the image processingapparatus.

A yet further aspect of the invention is directed to an image processingapparatus including: a storing unit configured to store a first computerprogram and a second computer program; and a processing unit configuredto process a picked-up image picked up by an image pickup apparatus. Thefirst computer program is updated using first data stored in an externalstorage device. The second computer program is updated using second datastored in an information processing apparatus.

With this configuration, in the image processing apparatus, the firstcomputer program is updated using the first data stored in the externalstorage device and the second computer program is updated using thesecond data stored in the information processing apparatus.Consequently, the image processing apparatus can easily update thecomputer programs.

In the aspect of the invention, in the image processing apparatus, theimage processing apparatus may include a first updating unit configuredto operate according to execution of another program different from thefirst computer program and the second computer program, read the firstdata stored in the external storage device, and update the firstcomputer program on the basis of the read first data.

With this configuration, the image processing apparatus operatesaccording to the execution of another program different from the firstcomputer program and the second computer program, reads the first datastored in the external storage device, and updates the first computerprogram on the basis of the read first data. Consequently, the imageprocessing apparatus can update the first computer program withoutexecuting the first computer program. Therefore, it is possible tosuppress the first computer program from being damaged by the update ofthe first computer program during the execution of the first computerprogram.

In the aspect of the invention, in the image processing apparatus, thefirst updating unit may back up the first computer program before theupdate in a storage region of the external storage device and thereafterupdate the first computer program on the basis of the first data.

With this configuration, the image processing apparatus backs up thefirst computer program before the update in the storage region of theexternal storage device and thereafter updates the first computerprogram on the basis of the first data. Consequently, the imageprocessing apparatus does not need to secure a storage region for backupin a storage region of the image processing apparatus. It is possible toreduce costs related to securing of the storage region of the imageprocessing apparatus.

In the aspect of the invention, the image processing apparatus mayfurther include: a checking unit configured to determine whether thefirst data is stored in the external storage device; and a displaycontrol unit configured to cause the display unit to display informationindicating an error when the checking unit determines that the firstdata is not stored in the external storage device. When the checkingunit determines that the first data is stored in the external storagedevice, the first updating unit may update the first computer program onthe basis of the first data.

With this configuration, the image processing apparatus determineswhether the first data is stored in the external storage device, when itis determined that the first data is not stored in the external storagedevice, causes the display unit to display the information indicating anerror, and, when it is determined that the first data is stored in theexternal storage device, updates the first computer program on the basisof the first data. Consequently, the image processing apparatus cansuppress the update of the first computer program from being continuedby mistake in a state in which the first data is not stored in theexternal storage device.

In the aspect of the invention, the image processing apparatus mayfurther includes: a communication unit configured to communicate with anexternal apparatus; and a second updating unit configured to operateaccording to the execution of the first computer program, acquire thesecond data from the information processing apparatus via thecommunication unit, and update the second computer program on the basisof the acquired second data.

With this configuration, the image processing apparatus operatesaccording to the execution of the first computer program, acquires thesecond data from the information processing apparatus via thecommunication unit, and updates the second computer program on the basisof the acquired second data. Consequently, the image processingapparatus can easily update the second computer program with theinformation processing apparatus.

A still yet further aspect of the invention is directed to a robotsystem including: a robot configured to perform predetermined work; animage pickup apparatus configured to pick up an image of a range relatedto the predetermined work; an image processing apparatus configured toprocess the picked-up image picked up by the image pickup apparatus; anda control apparatus configured to control the robot on the basis of aresult of the processing by the image processing apparatus. The imageprocessing apparatus includes: a storing unit configured to store afirst computer program and a second computer program; and a processingunit configured to process a picked-up image picked up by the imagepickup apparatus. The first computer program is updated using first datastored in an external storage device. The second computer program isupdated using second data stored in an information processing apparatus.

With this configuration, in the robot system, the first computer programis updated using the first data stored in the external storage deviceand the second computer program is updated using the second data storedin the information processing apparatus. Consequently, the imageprocessing apparatus can easily update the computer programs.

As explained above, in the image processing apparatus and the robotsystem, the first computer program is updated using the first datastored in the external storage device and the second computer program isupdated using the second data stored in the information processingapparatus. Consequently, the image processing apparatus and the robotsystem can easily update the computer programs.

BRIEF DESCRIPTION OF THE DRAWINGS

The invention will be described with reference to the accompanyingdrawings, wherein like numbers reference like elements.

FIG. 1 is a configuration diagram showing an example of a robot systemaccording to a first embodiment.

FIG. 2 is a schematic block diagram showing the configuration of animage processing apparatus according to the first embodiment.

FIG. 3 is a diagram for explaining an example of LAN port names, avirtual LAN port name, an IP address of the virtual LAN port, andidentification information of a bridge target LAN port of a firstcommunication connecting unit and a second communication connecting unitaccording to the first embodiment.

FIG. 4 is a diagram for explaining an example of the configuration of arobot system in which a plurality of image processing apparatuses areconnected according to the first embodiment.

FIG. 5 is a diagram for explaining an example of a network setting imagedisplayed on a display of an information processing apparatus accordingto the first embodiment.

FIG. 6 is a diagram for explaining an example of a network settingscreen displayed on a display unit connected to the image processingapparatus according to the first embodiment.

FIG. 7 is a flowchart of a processing procedure of setting of a networkrelation performed by the image processing apparatus according to thefirst embodiment.

FIG. 8 is a flowchart of a processing procedure for a received requestperformed by the image processing apparatus according to the firstembodiment.

FIG. 9 is a diagram for explaining an example of the configuration of arobot system in which an information processing apparatus is connectedto one of the plurality of image processing apparatuses according to thefirst embodiment.

FIG. 10 is a diagram for explaining an example of the configuration of arobot system in which a plurality of control apparatuses share one imageprocessing apparatus according to the first embodiment.

FIG. 11 is a schematic block diagram showing the configuration of animage processing apparatus according to a second embodiment.

FIG. 12 is a diagram for explaining an example of LAN port names, avirtual LAN port name, an IP address of the virtual LAN port, andidentification information of a bridge target LAN port of a firstcommunication connecting unit to a third communication connecting unitaccording to the second embodiment.

FIG. 13 is a diagram for explaining an example of a setting screen in abridge mode according to the second embodiment.

FIG. 14 is a flowchart for explaining a processing procedure of settingof a network relation performed by the image processing apparatusaccording to the second embodiment.

FIG. 15 is a schematic block diagram showing the configuration of animage processing apparatus according to a third embodiment.

FIG. 16 is a diagram for explaining a network segment according to thethird embodiment.

FIG. 17 is a diagram for explaining an example of a relation between IPaddresses and network segments allocated in advance to a firstimage-pickup-apparatus connecting unit to a fourthimage-pickup-apparatus connecting unit stored in a storing unitaccording to the third embodiment.

FIG. 18 is a diagram for explaining an example of IP addresses allocatedin advance to image pickup apparatuses connected to the firstimage-pickup-apparatus connecting unit to the fourthimage-pickup-apparatus connecting unit and stored in the storing unitaccording to the third embodiment.

FIG. 19 is a flowchart for explaining a processing procedure performedby an image-pickup-apparatus communication unit according to the thirdembodiment.

FIG. 20 is a diagram for explaining an example of network segments andIP addresses in which the network segments are different in an n-thimage-pickup-apparatus connecting unit and an image pickup apparatusaccording to the third embodiment.

FIG. 21 is a diagram for explaining an example of network segments andIP addresses in which the network segments and the IP addresses are thesame in the n-th image-pickup-apparatus connecting unit and the imagepickup apparatus according to the third embodiment.

FIG. 22 is a flowchart of a processing procedure performed by animage-pickup-apparatus communication unit according to a fourthembodiment.

FIG. 23 is a diagram for explaining an example of network segments andIP addresses in which the network segments are the same in anexternal-communication connecting unit, an n-th image-pickup-apparatusconnecting unit, and an image pickup apparatus according to the fourthembodiment.

FIG. 24 is a diagram showing an example of the hardware configuration ofan image processing apparatus according to a fifth embodiment.

FIG. 25 is a diagram showing an example of the functional configurationof the image processing apparatus.

FIG. 26 is a flowchart for explaining an example of a flow ofinitialization processing and data saving processing of the imageprocessing apparatus performed by a control unit.

FIG. 27 is a table showing an example of rules for a change of alighting state of an output unit by an output control unit.

FIG. 28 is a configuration diagram showing a robot system according to asixth embodiment.

FIG. 29 is a block diagram showing the configuration of an imageprocessing apparatus according to the sixth embodiment.

FIG. 30 is a block diagram showing the configuration of an informationprocessing apparatus according to the sixth embodiment.

FIG. 31 is a diagram showing an example of a system display screen.

FIG. 32 is a diagram showing an example of an addition method inquiryscreen.

FIG. 33 is a diagram showing an example of a search packet.

FIG. 34 is a diagram showing an example of a camera setting displayscreen.

FIG. 35 is a diagram showing an example of a system integration settingdisplay screen.

FIG. 36 is a diagram showing an example of a search response packet.

FIG. 37 is a diagram for explaining a return destination of the searchresponse packet.

FIG. 38 is a diagram showing an example of a search result screen.

FIG. 39 is a diagram showing an example of a network setting screen.

FIG. 40 is a diagram showing an example of a change packet.

FIG. 41 is a diagram for explaining determination of necessity of anetwork setting information change.

FIG. 42 is a diagram showing an example of a change response packet.

FIG. 43 is a sequence chart showing network processing according to asixth embodiment.

FIG. 44 is a diagram showing an example of the hardware configuration ofa control apparatus according to a seventh embodiment.

FIG. 45 is a diagram showing an example of the hardware configuration ofan image processing apparatus.

FIG. 46 is a diagram showing an example of the functional configurationof the control apparatus.

FIG. 47 is a diagram showing an example of the functional configurationof an image processing apparatus.

FIG. 48 is a flowchart showing an example of a flow of processingperformed by a control unit of the control apparatus.

FIG. 49 is a diagram showing an example of a correspondence relationamong an event indicating abnormality of the image processing apparatus,a condition under which the event indicating the abnormality of theimage processing apparatus is detected, a state of the image processingapparatus, and a state code for identifying the state of the imageprocessing apparatus.

FIG. 50 is a table showing an example of rules for a change of alighting state of an output unit by an output control unit.

FIG. 51 is a table showing an example of a correspondence relationbetween a state code for identifying a state of the image processingapparatus determined by a state determining unit in step S330 and amessage recorded in an error history together with the state code.

FIG. 52 is a diagram showing an example of a GUI for displayingdetection values included in detection information acquired from theimage processing apparatus.

FIG. 53 is a diagram showing an example of a hardware configuration ofan image processing apparatus according to an eighth embodiment.

FIG. 54 is a diagram illustrating a plurality of files stored in anexternal storage.

FIG. 55 is a diagram showing an example of the functional configurationof the image processing apparatus during the start of a normal timestart OS.

FIG. 56 is a diagram showing an example of the functional configurationof the image processing apparatus during the start of a failure timestart OS.

FIG. 57 is a flowchart showing an example of a flow of applicationupdate processing performed by a control unit.

FIG. 58 is a flowchart showing an example of a flow of OS updateprocessing performed by the control unit.

FIG. 59 is a diagram showing an example of a CUI for displaying a menuof the failure time start OS.

FIG. 60 is an example of a CUI for displaying a warning for an eventthat occurs when update of the normal time start OS is executed andchecking whether the update of the normal time start OS is executed.

FIG. 61 is a diagram showing an example of a CUI for displayinginformation indicating success of the update of the normal time startOS.

DESCRIPTION OF EXEMPLARY EMBODIMENTS First Embodiment

An embodiment of the invention is explained below with reference to thedrawings.

FIG. 1 is a configuration diagram showing an example of a robot system 1according to this embodiment. The robot system 1 includes an informationprocessing apparatus 5, an image pickup apparatus 10, a robot 20, acontrol apparatus 30, and an image processing apparatus 40.

The robot system 1 receives, with the information processing apparatus5, operation from a user and causes the robot 20 to performpredetermined work on the basis of the received operation. Thepredetermined work indicates, for example, as shown in FIG. 1, work forrearranging a work target M, which is arranged on the upper surface of aworkbench TB, in a predetermined position. However, the predeterminedwork may be other work. The workbench TB is a stand such as a table.However, instead of the stand, the workbench TB may be a floor surface,a wall surface, or the like as long as it is possible to arrange thework target M thereon.

The work target M is an object that can be gripped by the robot 20 andis, for example, a component of an industrial product such as a screw ora bolt, and may be another object. In FIG. 1, the work target M is shownas an object having a rectangular parallelepiped shape. The robot system1 causes the robot 20 to perform the predetermined work on the basis ofthe position and the posture of the work target M calculated by theimage processing apparatus 40.

The information processing apparatus 5 is, for example, a displayequipped apparatus, in which an application program for controlling therobot 20 can be installed, such as a notebook PC, a desktop PC, a tabletPC, or a multi-function cellular phone terminal (a smart phone). Theapplication program causes a display unit of the information processingapparatus 5 to display GUIs having various functions such as a GUI forcreating a control program for controlling the robot 20 and a GUI fordisplaying a state of the robot system 1 (respective states of thecontrol apparatus 30 and the image processing apparatus 40 (e.g.,various statuses and presence or absence of a failure)). The GUIs are,for example, a GUI for creating an image processing program forprocessing an image picked up by the image pickup apparatus 10 and acontrol program for controlling the robot 20 and a GUI for displaying anoperation state of the robot system 1.

The information processing apparatus 5 receives operation from the uservia a GUI displayed on the display unit, creates the control program onthe basis of the received operation, and compiles the control program.The control program is converted by the compile into an object code of aformat executable by the control apparatus 30. The informationprocessing apparatus 5 receives operation from the user via the GUIdisplayed on the display unit and outputs the object code to the controlapparatus 30 on the basis of the received operation. For example, aplurality of processing procedures are described in the object code. Ina processing procedure in which an apparatus that executes the objectcode performs communication with an external apparatus, for each kind ofprocessing, information indicating a transmission source of a requestfor the processing (the apparatus that executes the object code) andinformation indicating a transmission destination (the externalapparatus) are described in association with each other. The informationindicating the transmission source is an IP address set in theinformation processing apparatus 5 or the control apparatus 30. Theinformation indicating the transmission destination is an IP address setin the control apparatus 30 or a communication connecting unit 41 (FIG.2) of the image processing apparatus 40.

The information processing apparatus 5 receives operation from the uservia the GUI displayed on the display unit and performs settingconcerning a network for the image processing apparatus 40. The settingconcerning a network includes setting of an IP address of the imageprocessing apparatus 40, an IP mask (also referred to as IP addresssub-network mask), and an address of a gateway (hereinafter alsoreferred to as gateway address) and setting for changing a bridge modeto an ON state. The bridge mode is a mode for setting the same LAN portname and the same LAN port IP address in a first communicationconnecting unit 411 (FIG. 2) and a second communication connecting unit412 (FIG. 2) included in the image processing apparatus 40 and using theLAN port name and the LAN port IP address.

The information processing apparatus 5 is communicably connected to thecontrol apparatus 30 by a cable. Wired communication via the cable isperformed according to a standard such as Ethernet (registeredtrademark).

The image pickup apparatus 10 is, for example, a camera including a CCD(Charge Coupled Device), which is an image pickup device that convertscondensed light into an electric signal, and a CMOS (Complementary MetalOxide Semiconductor). The image pickup apparatus 10 is communicablyconnected to the image processing apparatus 40 by a cable. Wiredcommunication via the cable is performed, for example, according to astandard such as the Ethernet (registered trademark) or the USB. Notethat the image pickup apparatus 10 and the image processing apparatus 40may be connected by radio communication performed according to acommunication standard such as Wi-Fi (registered trademark). When theimage processing apparatus 40 is connectable to a plurality of imagepickup apparatuses 10, the plurality of image pickup apparatuses 10 maybe provided.

The image pickup apparatus 10 is set in a position where an image of arange including the work target M can be picked up as a picked-up image.The image pickup apparatus 10 is configured to pick up a still image asthe picked-up image. Instead, the image pickup apparatus 10 may beconfigured to pick up a moving image as the picked-up image.

The robot 20 acquires a control signal based on the position and theposture of the work target M from the control apparatus 30 and performspredetermined work on the basis of the acquired control signal. Therobot 20 is a single-arm robot including an end effector END includingnail sections capable of gripping an object (in this example, the worktarget M), a manipulator MNP, and a not-shown plurality of actuators.The single-arm robot indicates a robot including one arm configured bythe end effector END and the manipulator MNP (or only the manipulatorMNP).

Note that the robot 20 may be a SCARA robot (a horizontal articulatedrobot), a double-arm robot, or the like instead of the single-arm robot.The SCARA robot is a robot in which a manipulator moves only in thehorizontal direction and only a slide shaft at the distal end of themanipulator moves up and down. The double-arm robot is a robot includingtwo arms, each configured by the end effector END and the manipulatorMNP (or only the manipulator MNP).

The arm of the robot 20 is a six-axis vertical articulated type in theexample shown in FIG. 1. A support stand, the manipulator MNP, and theend effector END can perform actions of a six-axis degree of freedomaccording to an associated action by the actuators. Note that the arm ofthe robot 20 may act at five degrees of freedom (five axes) or less ormay act at seven degrees of freedom (seven axes) or more. In thefollowing explanation, the operation of the robot 20 performed by thearm including the end effector END and the manipulator MNP is explained.

The robot 20 is communicably connected to the control apparatus 30 by,for example, a cable. Wired communication via the cable is performed,for example, according to a standard such as the Ethernet (registeredtrademark) or the USB. Note that the robot 20 and the control apparatus30 may be connected by radio communication performed according to acommunication standard such as the Wi-Fi (registered trademark). Notethat, as shown in FIG. 1, the robot 20 is connected to the controlapparatus 30 set on the outside of the robot 20. However, instead, thecontrol apparatus 30 may be incorporated in the robot 20.

The control apparatus 30 acquires an object code from the informationprocessing apparatus 5 and controls, on the basis of the acquired objectcode, the robot 20 to perform the predetermined work. More specifically,in this example, the control apparatus 30 outputs, on the basis of theobject code, to the image processing apparatus 40, a request foracquiring a picked-up image of the range including the work target Mpicked up by the image pickup apparatus 10 and performing, on the basisof the acquired picked-up image, image processing for calculating aposition and a posture of the work target M. Note that the requestoutput to the image processing apparatus 40 by the control apparatus 30includes, as information indicating a transmission destination,information indicating setting concerning a network for thecommunication connecting unit (FIG. 2) of the image processing apparatus40.

The control apparatus 30 is communicably connected to the imageprocessing apparatus 40 by a LAN cable. Wired communication via the LANcable is performed, for example, according to a standard such as theEthernet (registered trademark). The control apparatus 30 outputs, tothe information processing apparatus 5, the information indicating thesetting concerning a network for the communication connecting unit 41(FIG. 2) output from the image processing apparatus 40 during the startof the image processing apparatus 40. The control apparatus 30 sharesthe information with the information processing apparatus 5.

After the image processing is finished by the image processing apparatus40, the control apparatus 30 acquires information indicating theposition and the posture of the work target M from the image processingapparatus 40. The control apparatus 30 generates a control signal basedon the acquired information concerning the position and the posture ofthe work target M and outputs the generated control signal to the robot20 to control the robot 20 to perform the predetermined work.

The image processing apparatus 40 acquires, according to the requestfrom the control apparatus 30 based on the object code, a picked-upimage of the range including the work target M from the image pickupapparatus 10. After acquiring the picked-up image from the image pickupapparatus 10, the image processing apparatus 40 performs, on the basisof the acquired picked-up image, image processing for calculating aposition and a posture of the work target M. The image processingapparatus 40 outputs information indicating the position and the postureof the work target M obtained as a result of the image processing to thecontrol apparatus 30 via the LAN cable.

The image processing apparatus 40 performs the setting concerning anetwork for the communication connecting unit 41 (FIG. 2) according tooperation by the user from the information processing apparatus 5.Alternatively, the user operates an input unit 60 (FIG. 2) on the basisof an image displayed on a display unit 50 (FIG. 2) connected to theimage processing apparatus 40, whereby the image processing apparatus 40performs the setting concerning a network for the communicationconnecting unit 41 (FIG. 2).

When the image processing apparatus 40 is started, the image processingapparatus 40 outputs the information indicating the setting concerning anetwork for the communication connecting unit 41 (FIG. 2) to the controlapparatus 30.

Note that, instead of being configured to perform these kinds ofprocessing according to the request from the control apparatus 30 basedon the object code, the image processing apparatus 40 may be configuredto cyclically acquire a picked-up image from the image pickup apparatus10 and, every time the picked-up image is acquired, apply the imageprocessing to the acquired picked-up image to calculate a position and aposture of the work target M. In this case, the image processingapparatus 40 outputs the information indicating the position and theposture of the work target M calculated according to the request fromthe control apparatus 30 to the control apparatus 30.

The schematic configuration of the image processing apparatus 40 isexplained.

FIG. 2 is a schematic block diagram showing the configuration of theimage processing apparatus 40 according to this embodiment. As shown inFIG. 2, the image processing apparatus 40 includes a communicationconnecting unit 41 (a second connecting unit), a communication unit 42,an input receiving unit 43, a control unit 44 (a processing unit), astoring unit 45, an image processing unit 46 (a processing unit), animage acquiring unit 47 (a first connecting unit), an image acquiringunit 48 (a first connecting unit), and an image-pickup-apparatus controlunit 49. The communication connecting unit 41 includes a firstcommunication connecting unit 411 and a second communication connectingunit 412. The display unit 50 and the input unit 60 are connected to theimage processing apparatus 40. Note that, in this embodiment, an n-thcommunication connecting unit 41 n (n is an integer 1 or 2) is alsoreferred to as port or LAN port.

The display unit 50 displays image information output by the controlunit 44. The display unit 50 is, for example, a liquid crystal displaydevice. The image information displayed on the display unit 50 is, forexample, information concerning images such as images picked up by animage pickup apparatus 10-1 and an image pickup apparatus 10-2 and animage of a setting screen for a network (hereinafter referred to asnetwork setting screen).

The input unit 60 is an input device operated by the user and is, forexample, a mouse, a keyboard, a pointing device, or a touch panelprovided on the display unit 50. The input unit 60 outputs operationinformation indicating a result of the operation to the image processingapparatus 40. For example, the user operates the input unit 60 toperform setting concerning a network on the setting screen for a networkdisplayed on the display unit 50.

LAN cables are respectively connected to the first communicationconnecting unit 411 and the second communication connecting unit 412.The first communication connecting unit 411 and the second communicationconnecting unit 412 respectively include LAN connectors. When thecommunication connecting unit 41 is used in a bridge mode, as shown inFIG. 3, a common virtual LAN port name is initially set in the firstcommunication connecting unit 411 and the second communicationconnecting unit 412. A common virtual LAN port address is set by theuser.

FIG. 3 is a diagram for explaining an example of LAN port names, avirtual LAN port name, an IP address of the virtual LAN port, andidentification information of a bridge target LAN port of the firstcommunication connecting unit 411 and the second communicationconnecting unit 412 according to the this embodiment. When thecommunication connecting unit 41 is used in the bridge mode, the firstcommunication connecting unit 411 and the second communicationconnecting unit 412 are recognized as having the same LAN port name andthe same IP address from the information processing apparatus 5 and thecontrol apparatus 30 connected to the image processing apparatus 40 viathe network. That is, in the robot system 1, an object code can be usedwithout being rewritten irrespective of whether the control apparatus 30is connected to the first communication connecting unit 411 or thesecond communication connecting unit 412 by the LAN cable because thefirst communication connecting unit 411 and the second communicationconnecting unit 412 have the same IP address. In the example shown inFIG. 3, in the first communication connecting unit 411 and the secondcommunication connecting unit 412, vbr0 is initially set as a commonvirtual LAN port name and aaa. bbb. ccc. ddd is set as an IP address ofa common virtual LAN port by the user. In the example shown in FIG. 3,eth0 is initially set as individual identification information in thefirst communication connecting unit 411 and eth1 is initially set asindividual identification information in the second communicationconnecting unit 412. The information shown in FIG. 3 is stored in thestoring unit 45 or the communication unit 42. Note that theidentification information is information invisible from an externalapparatus. Information recognizable by the external apparatus is thevirtual LAN port name vbr0 and the virtual LAN port IP address aaa. bbb.ccc. ddd.

The first communication connecting unit 411 or the second communicationconnecting unit 412 associates received identification information ofthe n-th communication connecting unit 41 n (n is an integer 1 or 2)with a request received from the control apparatus 30 via the LAN cableand outputs the request to the communication unit 42. The firstcommunication connecting unit 411 or the second communication connectingunit 412 transmits, according to the control by the communication unit42, from the n-th communication connecting unit 41 n that receives therequest, an image processing result and image information output by thecommunication unit 42 to the control apparatus 30 via the LAN cable.Note that the request received by the n-th communication connecting unit41 n and the image processing result and the image information to betransmitted include information indicating a transmission destination ofthe image processing result and the image information and informationindicating a transmission source of the image processing result and theimage information.

When the image processing apparatus 40 is started, the communicationunit 42 acquires and shares an IP address of an external apparatusconnected via the LAN cable and the first communication connecting unit411 and the second communication connecting unit 412. The externalapparatus is any one of the information processing apparatus 5, therobot 20, the control apparatus 30, and the image processing apparatus40.

When the image processing apparatus 40 is started, the communicationunit 42 transmits information indicating setting concerning a networkfor the communication connecting unit 41 to the control apparatus 30 viathe n-th communication connecting unit 41 n, to which the controlapparatus 30 is connected, and the LAN cable.

The communication unit 42 receives a request output by the communicationconnecting unit 41. The communication unit 42 extracts informationindicating a transmission destination included in the received requestand the identification information of the n-th communication connectingunit 41 n that outputs the request. The communication unit 42discriminates whether the extracted information indicating thetransmission destination of the request and information indicating theIP address of the first communication connecting unit 411 and the secondcommunication connecting unit 412 coincide with each other. When thekinds of information coincide with each other, the communication unit 42outputs the received request and information indicating a transmissionsource to the control unit 44. When the kinds of information do notcoincide with each other, the communication unit 42 outputs the receivedrequest to an m-th communication connecting unit 41 m (m is other than nand is an integer or 1 or 2) different from the n-th communicationconnecting unit 41 n that outputs the request. For example, when thekinds of information do not coincide with each other, the communicationunit 42 outputs the request received from the first communicationconnecting unit 411 to the second communication connecting unit 412.That is, in the case of the bridge mode, the first communicationconnecting unit 411 and the second communication connecting unit 412function as a network switch.

The communication unit 42 extracts identification information includedin the image processing result and the image information output by thecontrol unit 44. The communication unit 42 outputs the image processingresult and the image information output by the control unit 44 to then-th communication connecting unit 41 n corresponding to the extractedidentification information.

The input receiving unit 43 receives operation information from theinput unit 60 and outputs the received operation information to thecontrol unit 44.

The request output by the communication unit 42, the identificationinformation of the n-th communication connecting unit 41 n that receivesthe request, the operation information output by the input receivingunit 43, and the image processing result output by the image processingunit are input to the control unit 44. When the request output by thecommunication unit 42 is a request for performing setting concerning anetwork, the control unit 44 causes the display unit 50 to display anetwork setting image. The control unit 44 performs the settingconcerning a network according to an operation result of the useroperating the input unit 60 according to the network setting image. Thecontrol unit 44 causes the storing unit 45 to store a set result andoutputs the set result to the communication unit 42. Note that thesetting concerning a network is explained below.

When the request output by the communication unit 42 is a request forimage processing and an image pickup apparatus, the control unit 44outputs the input request and the identification information to theimage processing unit 46.

An image processing result to be input includes information indicatingthe position and the posture of the work target M. The control unit 44associates the information indicating the transmission source of therequest included in the request and the identification information withthe image processing result output by the image processing unit 46 andoutputs the image processing result to the communication unit 42. Thecontrol unit 44 associates the information indicating the transmissionsource of the request included in the request and the identificationinformation with the image information output by the image processingunit 46 and outputs the image information to the communication unit 42.

In the storing unit 45, a control program for the control unit 44 tocontrol the units of the image processing apparatus 40 is stored. In thestoring unit 45, initial setting concerning the communication connectingunit 41 shown in FIG. 3 and setting concerning a network set by the userare associated with each other and stored in the storing unit 45.

The image processing unit 46 applies, according to the request inputfrom the control unit 44, image processing to image information outputby the image-pickup-apparatus control unit 49 using a well-known methodand calculates a position and a posture of the work target M. The imageprocessing unit 46 outputs information indicating the calculatedposition and the calculated posture of the work target M to the controlunit 44. When a request to the image-pickup-apparatus control unit 49 isincluded in the information output by the control unit 44, the imageprocessing unit 46 outputs the request to the image-pickup-apparatuscontrol unit 49. The image processing unit 46 outputs the imageinformation output by the image-pickup-apparatus control unit 49 to thecontrol unit 44.

The image acquiring unit 47 acquires image information output by theimage pickup apparatus 10-1 and outputs the acquired image informationto the image-pickup-apparatus control unit 49. Note that the imageinformation includes image pickup apparatus identification informationindicating the image pickup apparatus 10-1.

The image acquiring unit 48 acquires image information output by theimage pickup apparatus 10-2 and outputs the acquired image informationto the image-pickup-apparatus control unit 49. Note that the imageinformation includes image pickup apparatus identification informationindicating the image pickup apparatus 10-2.

Note that, when the image information is an analog signal, the imageacquiring unit 47 and the image acquiring unit 48 may convert theacquired analog signal into a digital signal and output the digitalsignal to the image-pickup-apparatus control unit 49.

The image-pickup-apparatus control unit 49 selects, according to therequest input from the image processing unit 46, the image informationinput from the image acquiring unit 47 or the image acquiring unit 48and outputs the selected image information to the image processing unit46. Note that the image-pickup-apparatus control unit 49 may control,according to the request input from the image processing unit 46,sensitivity of image pickup of the image pickup apparatus 10-1 and theimage pickup apparatus 10-2, selection of a region for the image pickup,an angle of view of the image pickup, and the like.

An example of a configuration in which a plurality of image processingapparatuses 40 set in the bridge mode are connected is explained.

FIG. 4 is a diagram for explaining an example of the configuration of arobot system 1A in which the plurality of image processing apparatuses40 are connected according to this embodiment. Note that, in FIG. 4,apparatuses having functions same as the functions in the robot system 1shown in FIG. 1 are denoted by the same reference numerals and signs andexplanation of the apparatuses is omitted.

In the robot system 1A shown in FIG. 4, the control apparatus 30 isconnected to a first communication connecting unit 411-1 of an imageprocessing apparatus 40-1 via a LAN cable. An image processing apparatus40-2 is connected to a second communication connecting unit 412-1 via aLAN cable. The image pickup apparatus 10-1, the display unit 50, and theinput unit 60 are connected to the image processing apparatus 40-1.

The image processing apparatus 40-1 is connected to a firstcommunication connecting unit 411-2 of the image processing apparatus40-2 via a LAN cable. An image processing apparatus 40-3 is connected toa second communication connecting unit 412-2 via a LAN cable. The imagepickup apparatus 10-2 is connected to the image processing apparatus40-2.

The image processing apparatus 40-2 is connected to a firstcommunication connecting unit 411-3 of the image processing apparatus40-3 via a LAN cable. Nothing is connected to a second communicationconnecting unit 412-3. An image pickup apparatus 10-3 is connected tothe image processing apparatus 40-3.

In the example shown in FIG. 4, a common first virtual LAN port name(e.g., vbr0) and a common first IP address (e.g., aaa. bbb. ccc. dd0)are set in the first communication connecting unit 411-1 and the secondcommunication connecting unit 412-1 of the image processing apparatus40-1. A common second virtual LAN port name (e.g., vbr1) and a commonsecond IP address (e.g., aaa. bbb. ccc. dd1) are set in the firstcommunication connecting unit 411-2 and the second communicationconnecting unit 412-2 of the image processing apparatus 40-2. A commonthird virtual LAN port name (e.g., vbr2) and a common third IP address(e.g., aaa. bbb. ccc. dd2) are set in the first communication connectingunit 411-3 and the second communication connecting unit 412-3 of theimage processing apparatus 40-3.

As shown in FIG. 4, the image processing apparatuses 40-1 to 40-3 aretied in a row (daisy-chain connected) without using a network switch.

In the robot system in the past, the image processing apparatus includesonly one communication connecting unit. Therefore, when a plurality ofimage processing apparatuses are connected, it is necessary to provide anetwork switch and a power supply for the network switch between thecontrol apparatus 30 and the plurality of image processing apparatuses.When the network switch is provided in this way, compared with FIG. 4, adegree of freedom of wiring in a site where the robot system 1 is usedis limited. On the other hand, according to this embodiment, it ispossible to directly connect the control apparatus 30 and the imageprocessing apparatus 40-1 and directly connect the image processingapparatus 40-1 and the image processing apparatus 40-2 without using anetwork switch. Consequently, it is possible to improve a degree offreedom of wiring in a site where the robot system 1A is used.

Note that, in the example shown in FIG. 4, the image pickup apparatuses10 among the image pickup apparatuses 10-1 to 10-3 are connected thecorresponding image processing apparatuses 40-1 to 40-3 one by one.However, not only this, but two of the image pickup apparatuses 10 areconnected to each of the image processing apparatuses 40-1 to 40-3 asshown in FIG. 2.

In the example shown in FIG. 4, the display unit 50 and the input unit60 are connected only to the image processing apparatus 40-1. However,not only this, but the display unit 50 and the input unit 60 may beconnected to the image processing apparatus 40-2 or the image processingapparatus 40-3. Alternatively, the display unit 50 and the input unit 60may be connected to each of the image processing apparatuses 40-1 to40-3.

In the example shown in FIG. 4, the robot system 1A includes the threeimage processing apparatuses 40. However, the number of image processingapparatuses 40 may be two or four or more.

Setting concerning a network for the image processing apparatus 40 isexplained. The user performs the setting concerning a network byoperating the information processing apparatus 5 and the imageprocessing apparatus 40.

First, an example is explained in which the user performs the settingconcerning a network by operating the information processing apparatus5.

FIG. 5 is a diagram for explaining an example of a network setting imageg101 displayed on a display of the information processing apparatus 5according to this embodiment. As shown in FIG. 5, the network settingimage g101 includes an image g111 including images of various kinds ofinformation and images of addresses related to a network and an imageg121 including images of buttons for performing various setting.

The image g111 includes, as the images of the various kinds ofinformation, an image g112 indicating a model name of the imageprocessing apparatus 40, an image g113 indicating a firmware version ofthe image processing apparatus 40, and an image g114 indicating a MAC(Media Access Control) address of the image processing apparatus 40. Theimage g101 includes, as the images of the addresses related to anetwork, an image g115 indicating an IP address, an image g116indicating an IP mask, and an image g117 indicating a gateway addressset in common in the first communication connecting unit 411 and thesecond communication connecting unit 412 of the image processingapparatus 40. Note that the images g115 to g117 shown in FIG. 4 areimages already input by the user. The image g121 includes an image g122of a (Close) button for closing the network setting image g101 and animage g123 of an (Apply) button for applying input setting. The imageg121 includes an image g124 of a (Restore) button for restoring inputsetting, and an image g125 of an (Export Status) button for outputting aset state.

Note that the network setting image g101 shown in FIG. 5 is an example.The arrangement of the images of the buttons and the like is not limitedto the arrangement shown in the figure. Images of other buttons may bedisplayed.

First, the user operates, on a not-shown setting screen, a keyboardincluded in the information processing apparatus 5 or a mouse connectedto the information processing apparatus 5 to select whether the firstcommunication connecting unit 411 and the second communicationconnecting unit 412 of the image processing apparatus 40 are used in thebridge mode.

In the following explanation, the bridge mode is selected.

The user operates an input unit (e.g., the keyboard) included in theinformation processing apparatus 5 to input an IP address, an IP mask,and a gateway address. First, the user operates the keyboard to inputthe IP address. After the input, the user operates an input unit such asthe mouse connected to the information processing apparatus 5 to selectthe image g123 of the Apply button. Subsequently, similar1 y, the useroperates the keyboard to input the IP mask and operates the mouse toselect the image g123 of the Apply button. Further, similar1 y, the useroperates the keyboard to input the gateway address and operates themouse to select the image g123 of the Apply button. When all thesettings end, the user selects the image g125 of the button foroutputting a state. Note that, when redoing the settings, the useroperates the mouse to select the image g124 of the restore button.According to the operation explained above, the information processingapparatus 5 performs network setting of the image processing apparatus40 via the control apparatus 30. Note that, after inputting all of theIP address, the IP mask, and the gateway address, the user may operatethe input unit to select the image g123 of the Apply button to reflectan input result. Consequently, the user can apply, with simpleoperation, the same network setting to the first communicationconnecting unit 411 and the second communication connecting unit 412.

An example is explained in which the user operates the image processingapparatus 40 to perform setting concerning a network.

FIG. 6 is a diagram for explaining an example of a network setting imageg201 displayed on the display unit 50 connected to the image processingapparatus 40 according to this embodiment. As shown in FIG. 6, thenetwork setting image g201 includes an image g211 including images ofvarious kinds of information and images of addresses related to anetwork and an image g221 including images of buttons for performingvarious settings.

The image g211 is the same as the image g111 shown in FIG. 5.

The image g221 includes an image g222 of a (Close) button for closingthe network setting image g201, an image g223 of an (Apply) button forapplying input setting, and an image g224 of a (Restore) button forrestoring the input setting. The image g221 includes an image g225 of aten key button, an image g226 of a (Del) button for deleting an inputvalue, an image g227 of an (End) button for ending an input, and animage g228 of a (Bksp) button for backspacing. Note that the image g225of the ten key button includes buttons corresponding to numbers 0 to 9and a button of a dot (.).

Note that the network setting image g201 shown in FIG. 6 is an example.The arrangement of the images of the buttons and the like is not limitedto the arrangement shown in the figure. Images of other buttons may bedisplayed.

First, the user operates, on a not-shown setting screen, the input unit60 to select whether the first communication connecting unit 411 and thesecond communication connecting unit 412 of the image processingapparatus 40 are used in the bridge mode. In the following explanation,the bridge mode is selected.

The user selects, with the input unit 60, the network setting image g201displayed on the display unit 50 and performs network setting. Forexample, the user selects, with the mouse, the images of the buttons ofthe ten key button to input an IP address and selects, with the mouse,the image g223 of the Apply button to decide the input.

Subsequently, the user selects, with the mouse, the images of thebuttons of the ten key button and the image g223 of the Apply button toperform network setting. Consequently, the user can easily apply thesame network setting to the first communication connecting unit 411 andthe second communication connecting unit 412.

Note that, as in the example shown in FIG. 4, when a plurality of imageprocessing apparatuses 40 are provided, the user sequentially connects,for example, the display unit 50 and the input unit 60 to the pluralityof image processing apparatuses 40, for which setting concerning anetwork is performed, and operates the input unit 60 to perform thesetting concerning a network for each of the image processingapparatuses 40.

An example is explained in which the user performs setting of theplurality of image processing apparatuses 40 concerning a network usingthe information processing apparatus 5. The user switches, for example,with the image g114 indicating a MAC address displayed on the networksetting image g101, the network setting image g101 for each of the imageprocessing apparatuses 40 and performs the setting concerning a networkfor each of the image processing apparatuses 40 in the same manner asthe procedure explained with reference to FIG. 4. However, in this case,an IP address is input using the keyboard of the information processingapparatus 5.

In the examples shown in FIGS. 5 and 6, the setting concerning whetherthe bridge mode is used is performed on not-shown another screen.However, not only this, but the network setting image g101 shown in FIG.5 and the network setting image g201 shown in FIG. 6 may include animage of a setting button for the bridge mode.

In the example explained above, the user uses the first communicationconnecting unit 411 and the second communication connecting unit 412 inthe bridge mode. However, in modes other than the bridge mode, the firstcommunication connecting unit 411 and the second communicationconnecting unit 412 can be used in another IP address. In this case, theuser operates the information processing apparatus 5 or the imageprocessing apparatus 40 to perform the setting of each of the firstcommunication connecting unit 411 and the second communicationconnecting unit 412 concerning a network. In this case, for example,vbr0 is allocated to the first communication connecting unit 411 as aLAN port name by the communication unit 42. For example, aaa. bbb. ccc.dd0 is set in the first communication connecting unit 411 as an IPaddress by the user. For example, vbr1 is allocated to the secondcommunication connecting unit 412 as a LAN port name by thecommunication unit 42. For example, aaa. bbb. ccc. dd1 is set in thesecond communication connecting unit 412 as an IP address by the user.

Processing of network-related setting performed by the image processingapparatus 40 is explained.

FIG. 7 is a flowchart for explaining a processing procedure of thenetwork-related setting performed by the image processing apparatus 40according to this embodiment. Note that, as explained above, the useroperates the information processing apparatus 5 or the image processingapparatus 40 to perform the network-related setting.

(Step S1) The control unit 44 discriminates whether the bridge mode isused in setting (hereinafter referred to as bridge mode ON). When thebridge mode is ON (YES in step S1), the control unit 44 proceeds to stepS2. When the bridge mode is not ON (NO in step S1), the control unit 44proceeds to step S3.

(Step S2) The user inputs a common IP address, a common IP mask, and acommon gateway address to a plurality of n-th communication connectingunits 41 n (n is integer 1 and 2) used in the bridge mode of the firstcommunication connecting unit 411 and the second communicationconnecting unit 412. The control unit 44 receives information concerninga network input by the user and performs setting concerning a networkfor the first communication connecting unit 411 and the secondcommunication connecting unit 412. The control unit 44 causes thestoring unit 45 to store the set information concerning a network andends the processing.

(Step S3) The control unit 44 sets IP addresses, IP masks, and gatewayaddresses set by the user respectively for the first communicationconnecting unit 411 and the second communication connecting unit 412.The control unit 44 causes the storing unit 45 to store the setinformation concerning a network and ends the processing.

The processing of the network-related setting performed by the imageprocessing apparatus 40 ends.

Processing for a received request performed by the image processingapparatus 40 is explained.

FIG. 8 is a flowchart of a processing procedure for a received requestperformed by the image processing apparatus 40 according to thisembodiment.

(Step S11) The communication unit 42 acquires a request output by thecontrol apparatus 30.

(Step S12) The communication unit 42 extracts an IP address of atransmission destination included in the acquired request and extractsidentification information of the n-th communication connecting units 41n for which the request is received.

(Step S13) The communication unit 42 discriminates whether the IPaddress extracted in step S12 coincides with an IP address associatedwith the identification information. When discriminating that theextracted IP address coincides with the IP address associated with theidentification information (YES in step S13), the communication unit 42proceeds to step S14. When discriminating that the extracted IP addressdoes not coincide with the IP address associated with the identificationinformation (NO in step S13), the communication unit 42 proceeds to stepS16.

(Step S14) The communication unit 42 discriminates whether the bridgemode is ON. When discriminating that the bridge mode is ON (YES in stepS14), the communication unit 42 proceeds to step S15. When determiningthat the bridge mode is not ON (NO in step S14), the communication unit42 ends the processing.

(Step S15) The communication unit 42 outputs a request to the controlunit 44. After the output, the communication unit 42 ends theprocessing.

(Step S16) The communication unit 42 outputs a request to acommunication connecting unit having identification informationdifferent from the received identification information. After theoutput, the communication unit 42 ends the processing.

The processing for the received request performed by the imageprocessing apparatus 40 ends.

A specific example of the processing performed by the image processingapparatuses 40-1 to 40-3 is explained with reference to FIG. 4. Notethat, in the following explanation, it is assumed that, in each of theimage processing apparatuses 40-1 to 40-3, the bridge mode is ON. An IPaddress common to the first communication connecting unit 411-1 and thesecond communication connecting unit 412-1 of the image processingapparatus 40-1 is represented as aaa. bbb. ccc. dd0, identificationinformation of the first communication connecting unit 411-1 isrepresented as eth0, and identification information of the secondcommunication connecting unit 412-1 is represented as eth1. An IPaddress common to the first communication connecting unit 411-2 and thesecond communication connecting unit 412-2 of the image processingapparatus 40-2 is represented as aaa. bbb. ccc. dd1, identificationinformation of the first communication connecting unit 411-2 isrepresented as eth0, and identification information of the secondcommunication connecting unit 412-2 is represented as eth1. An IPaddress common to the first communication connecting unit 411-3 and thesecond communication connecting unit 412-3 of the image processingapparatus 40-3 is represented as aaa. bbb. ccc. dd2, identificationinformation of the first communication connecting unit 411-3 isrepresented as eth0, and identification information of the secondcommunication connecting unit 412-3 is represented as eth1. In thefollowing explanation, the communication units 42 respectively includedin the image processing apparatuses 40-1 to 40-3 are referred to ascommunication units 42-1 to 42-3 and the control units 44 respectivelyincluded in the image processing apparatuses 40-1 to 40-3 are referredto as control units 44-1 to 44-3. In the following explanation, when oneof the image processing apparatuses 40-1 to 40-3 is not specified, theimage processing apparatuses 40-1 to 40-3 are referred to as imageprocessing apparatuses 40.

The communication unit 42-1 of the image processing apparatus 40-1receives and acquires, with the first communication connecting unit411-1, a request output by the control apparatus 30. Subsequently, thecommunication unit 42-1 extracts the IP address aaa. bbb. ccc. dd1 of atransmission destination and the identification information eth0included in the request received by the first communication connectingunit 411-1. The extracted IP address is different from the IP addressassociated with the first communication connecting unit 411-1.Therefore, the communication unit 42-1 transmits the received requestfrom the second communication connecting unit 412-1 to the imageprocessing apparatus 40-2 via a LAN cable.

The communication unit 42-2 of the image processing apparatus 40-2receives and acquires, with the first communication connecting unit411-2, a request output by the image processing apparatus 40-1.Subsequently, the communication unit 42-2 extracts the IP address aaa.bbb. ccc. dd1 of the transmission destination and the identificationinformation eth0 included in the request received by the firstcommunication connecting unit 411-2. The extracted IP address coincideswith the IP address associated with the first communication connectingunit 411-2. Therefore, the communication unit 42-2 outputs the acquiredrequest to the control unit 44-2.

An example is explained in which apparatuses other than the imageprocessing apparatuses 40 are connected to the plurality of n-thcommunication connecting units 41 n (n is integers 1 and 2) included inthe communication connecting unit 41.

FIG. 9 is a diagram for explaining an example of the configuration of arobot system 1B in which an information processing apparatus isconnected to one of a plurality of image processing apparatusesaccording to this embodiment. As shown in FIG. 9, the components of therobot system 1A and the robot system 1B are the same. However,connection of the components is different. The robot system 1B isdifferent from the robot system 1A shown in FIG. 4 in that theinformation processing apparatus 5 is connected to the secondcommunication connecting unit 412-3 of the image processing apparatus40-3 via a LAN cable. Consequently, the information processing apparatus5 can transmit a request to the image processing apparatus 40 via theLAN cable not through the control apparatus 30. For example, after anobject code is output to the control apparatus 30, when a change of theobject code is unnecessary, the connection may be changed to aconnection state shown in FIG. 9 and used.

In the configuration shown in FIG. 9, the information processingapparatus 5 receives a control request to the n-th communicationconnecting unit 41 n according to operation from the user and outputsthe received control request to the n-th communication connecting unit41 n. The control request to the n-th communication connecting unit 41 nis, for example, a request for transmitting an image picked up by theimage pickup apparatus 10 to the information processing apparatus 5.Note that the control request includes an IP address set for the n-thcommunication connecting unit 41 n. The information processing apparatus5 receives, according to the control request, information output fromthe image processing apparatus 40. The information output from the imageprocessing apparatus 40 is, for example, an image picked up by the imagepickup apparatus 10. The information processing apparatus 5 may outputthe object code to the control apparatus 30 via the image processingapparatuses 40-1 to 40-3.

According to this embodiment, as in FIG. 4, the communication connectingunits 41 of the respective image processing apparatuses 40 can be usedas a network switch. Since the information processing apparatus 5 can bedirectly connected to the image processing apparatus 40, it is possibleto increase a degree of freedom of the arrangement of the robot system1B in a site where the robot system 1B is used.

FIG. 10 is a diagram for explaining an example of the configuration of arobot system 1C in which a plurality of control apparatuses (30-1 and30-2) share one image processing apparatus 40. As shown in FIG. 10, therobot system 1C includes an information processing apparatus 5A, theimage pickup apparatus 10-1, the image pickup apparatus 10-2, a robot20-1, a robot 20-2, a control apparatus 30-1, a control apparatus 30-2,the image processing apparatus 40-1, the display unit 50, and the inputunit 60.

As shown in FIG. 10, the information processing apparatus 5A includestwo connecting units. One connecting unit of the information processingapparatus 5A is connected to the control apparatus 30-1 and the otherconnecting unit is connected to the control apparatus 30-2. The robot20-1 is connected to the control apparatus 30-1. The control apparatus30-1 is connected to the first communication connecting unit 411-1 ofthe image processing apparatus 40-1 via a LAN cable. The robot 20-2 isconnected to the control apparatus 30-2. The control apparatus 30-2 isconnected to the second communication connecting unit 412-1 of the imageprocessing apparatus 40-1 via a LAN cable. The image pickup apparatus10-1, the image pickup apparatus 10-2, the display unit 50, and theinput unit 60 are connected to the image processing apparatus 40-1.

In the example shown in FIG. 10, the two control apparatuses 30-1 and30-2 share the one image processing apparatus 40-1.

Note that, in the robot system 1C shown in FIG. 10, the image processingapparatus 40-1 may output an image processing result and imageinformation to the control apparatus 30-1 and the control apparatus 30-2in a time division manner. In this case, the control apparatus 30-1 andthe control apparatus 30-2 may select information necessary for theapparatuses in the received image processing result and the receivedimage information on the basis of an object code.

In the example shown in FIG. 10, the first communication connecting unit411-1 and the second communication connecting unit 412-1 of the imageprocessing apparatus 40-1 may be set in the bridge mode. Different IPaddresses may be respectively set in the first communication connectingunit 411-1 and the second communication connecting unit 412-1.

According to this embodiment, in FIG. 10, as in FIG. 4, thecommunication connecting unit 41 of the image processing apparatus 40-ncan be used as a network switch. The plurality of control apparatuses 30can share the one image processing apparatus 40.

As shown in FIGS. 4, 9, and 10, an external apparatus connected to then-th communication connecting unit 41 n may be any one of another imageprocessing apparatus 40, the control apparatus 30, and the informationprocessing apparatus 5 (Or 5A).

The image processing apparatus 40 (or 40-1, 40-2, or 40-3) and the robotsystem 1 (or 1B or 1C) in this embodiment explained above include theplurality of n-th communication connecting unit 41 n. Therefore, it ispossible to perform connection to a plurality of external apparatuseswithout using a network switch. The same IP address can be set in theplurality of n-th communication connecting unit 41 n. As a result,according to this embodiment, an object code can be used without beingrewritten irrespective of whether the information processing apparatus 5(or 5A), the control apparatus 30, or the other image processingapparatus 40 is connected to the first communication connecting unit 411or the second communication connecting unit 412 by the LAN cable becausethe first communication connecting unit 411 and the second communicationconnecting unit 412 have the same IP address.

In the image processing apparatus 40 (or 40-1, 40-2, or 40-3) and therobot system 1 (or 1B or 1C) in this embodiment explained above, thesame IP address is set. Therefore, the user can connect the informationprocessing apparatus 5 (or 5A), the control apparatus 30, or the otherimage processing apparatus 40 to LAN ports of the first communicationconnecting unit 411 and the second communication connecting unit 412.The apparatuses connected in this way can access the LAN ports using thesame IP address. Consequently, the user does not need to be aware of IPaddresses of the LAN ports of the first communication connecting unit411 and the second communication connecting unit 412 and the LAN portsthat should be connected. As a result, the user can easily performconnection of the image processing apparatus 40 and the informationprocessing apparatus 5 (or 5A), the control apparatus 30, and the otherimage processing apparatus 40. Further, if the user performs operationto set the same address in the IP address described in the controlprogram, the user does not need to regenerate the control programcreated by the information processing apparatus 5 (or 5A).

According to this embodiment, the image processing apparatus 40 operatesas a network switch as well. Therefore, as in the examples shown inFIGS. 4, 9, and 10, it is possible to support various connection formswithout using a network switch. As a result, according to thisembodiment, it is possible to flexibly perform design of a layout of aproduction line.

With this configuration, the user can perform setting from theinformation processing apparatus 5 or the image processing apparatus 40without rewriting a control program. Therefore, it is possible toimprove convenience for the user.

Note that, in this embodiment, the example is explained in which theinformation processing apparatus 5 (or 5A) and the control apparatus 30are connected by the LAN cable. However, not only this, but theinformation processing apparatus 5 (or 5A) and the control apparatus 30may be wire-connected by a USB cable. The information processingapparatus 5 (or 5A) and the control apparatus 30 may be connected byradio communication performed according to a communication standard suchas the Wi-Fi (registered trademark). In this case, the informationprocessing apparatus 5 (or 5A) may include, in a request transmitted viaa USB terminal, information same as information transmitted from the LANport and transmit the request. The control apparatus 30 receiving thisinformation may convert the received information into data of the LANstandard and transmit the data to the image processing apparatus 40through the LAN cable.

Second Embodiment

In the first embodiment, the example is explained in which the imageprocessing apparatus 40 includes the two communication connecting units,i.e., the first communication connecting unit 411 and the secondcommunication connecting unit 412. However, an information processingapparatus may include two or more communication connecting units. Inthis embodiment, an example is explained in which an image processingapparatus includes three communication connecting units, i.e., a firstcommunication connecting unit to a third communication connecting unit.In the following explanation, components same as the components in thefirst embodiment are denoted by the same reference numerals and signsand explanation of the components is omitted or simplified.

FIG. 11 is a schematic block diagram showing the configuration of animage processing apparatus 40D according to this embodiment. As shown inFIG. 11, the image processing apparatus 40D includes a communicationconnecting unit 41D (a second connecting unit), the communication unit42, the input receiving unit 43, a control unit 44D, the storing unit45, the image processing unit 46, the image acquiring unit 47 (a firstconnecting unit), the image acquiring unit 48 (a first connecting unit),and the image-pickup-apparatus control unit 49. The communicationconnecting unit 41D includes the first communication connecting unit411, the second communication connecting unit 412, and a thirdcommunication connecting unit 413. The display unit 50 and the inputunit 60 are connected to the image processing apparatus 40D. Note thatfunctional units same as the functional units of the image processingapparatus 40 explained in the first embodiment are denoted by the samereference numerals and signs and explanation of the functional units isomitted.

A LAN cable is connected to the third communication connecting unit 413.The third communication connecting unit 413 includes a LAN connector. Inthe first to third communication connecting units 411 to 413, when thecommunication connecting unit 41D is used in a bridge mode, a commonvirtual LAN port name is initially set and a common virtual LAN portaddress is set by a user as shown in FIG. 12.

FIG. 12 is a diagram for explaining an example of LAN port names, avirtual LAN port name, an IP address of a virtual LAN port, andidentification information of a bridge target LAN port of the first tothird communication connecting units 411 to 413 according to thisembodiment. Note that, in the example shown in FIG. 12, the user setsthe bridge mode ON for the third communication connecting units, i.e.,the first to third communication connecting units 411 to 413.

When the bridge mode is ON, the first to third communication connectingunits 411 to 413 are recognized as having the same LAN port name and thesame IP address from the information processing apparatus 5 (FIG. 1) andthe control apparatus 30 connected to the image processing apparatus 40Dvia the network. As shown in FIG. 12, in the first to thirdcommunication connecting units 411 to 413, a common virtual LAN portname, for example, vbr0 is initially set. A common IP address of avirtual LAN port, for example, aaa. bbb. ccc. ddd is set by the user. Inthe example shown in FIG. 12, for example, eth0 is initially set asindividual identification information in the first communicationconnecting unit 411, eth1 is initially set as individual identificationinformation in the second communication connecting unit 412, and eth2 isinitially set as individual identification information in the thirdcommunication connecting unit 413. The information shown in FIG. 12 isstored in the communication unit 42 or the storing unit 45.

The control unit 44D performs, in addition to the operation of thecontrol unit 44 (FIG. 2), setting concerning a network for the thirdcommunication connecting unit 413 according to a result of operation bythe user. The setting concerning a network for the third communicationconnecting unit 413 may be performed either from the informationprocessing apparatus 5 (FIG. 1) or the image processing apparatus 40D.

Note that the image processing apparatus 40D in this embodiment may beapplied to the robot systems 1A, 1B, and 1C shown in FIGS. 4, 9, and 10.

A setting example of the bridge mode is explained.

FIG. 13 is a diagram for explaining an example of a setting screen g301for the bridge mode according to this embodiment. As shown in FIG. 13,the setting screen g301 includes an image g311 of a button for switchingthe bridge mode to an ON state and an OFF state and an image g312 of abutton for using the first communication connecting unit 411 in thebridge mode. Note that, when the OFF state of the bridge mode isselected by the user, the image g311 may be switched to an image of“bridge mode OFF”. Alternatively, the image g311 may indicate the ONstate when being displayed brightly and indicate the OFF state whenbeing displayed darkly. The setting screen g301 includes an image g313of a button for using the second communication connecting unit 412 inthe bridge mode and an image g313 of a button for using the thirdcommunication connecting unit 413 in the bridge mode.

The example shown in FIG. 13 is an example of an image after setting forusing the first communication connecting unit 411 and the secondcommunication connecting unit 412 in the bridge mode is performed by theuser.

Note that the setting screen g301 for the bridge mode shown in FIG. 13is displayed on the display of the information processing apparatus 5(FIGS. 1, 4, 9, and 10) or the display unit 50 connected to the imageprocessing apparatus 40D.

Processing of network-related setting performed by the image processingapparatus 40D is explained.

FIG. 14 is a flowchart of a processing procedure of the network-relatedsetting performed by the image processing apparatus 40D according tothis embodiment. Note that processing same as the processing performedby the image processing apparatus 40 in the first embodiment is denotedby the same reference signs.

(Step S1) The control unit 44D discriminates whether the bridge mode ONis set. When the bridge mode is ON (YES in step S1), the control unit44D proceeds to step S4. When the bridge mode is not ON (NO in step S1),the control unit 44D proceeds to step S3.

(Step S3) The control unit 44D performs processing as in step S3explained with reference to FIG. 7.

(Step S4) The user inputs a common IP address, a common IP mask, and acommon gateway address to a plurality of p-th communication connectingunits 41 p (p is at least two of integers 1 to 3) used in the bridgemode among the first to third communication connecting units 411 to 413.The control unit 44D receives information concerning a network input bythe user and performs setting concerning a network for the first tothird communication connecting units 411 to 413. The control unit 44Dcauses the storing unit 45 to store the set information concerning anetwork. The control unit 44D proceeds to step S5.

(Step S5) The control unit 44D sets an IP address, an IP mask, and agateway address set by the user in the q-th communication connectingunits 41 q (q is integers 1 to 3 other than p) not used in the bridgemode. The control unit 44D causes the storing unit 45 to storeinformation concerning the set network and ends the processing. Notethat, when the bridge mode is set in all of the first to thirdcommunication connecting units 411 to 413, the control unit 44D does notperform the processing in step S5.

The processing of the network-related setting performed by the imageprocessing apparatus 40D ends.

Note that, in this embodiment, the example is explained in which thecommunication connecting unit 41D includes the three communicationconnecting units, i.e., the first to third communication connectingunits 411 to 413. However, the number of communication connecting unitsincluded in the communication connecting unit 41D may be four or more.When there are a plurality of q-th communication connecting units 41 qnot set to the bridge mode ON, in FIG. 14, the control unit 44D repeatsthe processing in step S5 for each of the plurality of q-thcommunication connecting units 41 q.

The image processing apparatus 40D and the robot system 1D (e.g., arobot system in which the image processing apparatus 40 is replaced withthe image processing apparatus 40D in FIG. 4) in this embodimentexplained above include the plurality of p-th communication connectingunits 41 p. Therefore, the communication connecting unit 41D can be usedas a network switch. As a result, with the image processing apparatus40D in this embodiment, it is possible to perform connection to aplurality of external apparatuses without using a network switch. As inthe first embodiment, the user does not need to be aware of IP addressesof the LAN ports of the plurality of p-th communication connecting units41 p in which the same IP address is set and the LAN ports that shouldbe connected. As a result, the user can easily perform connection of theimage processing apparatus 40D and the information processing apparatus5, the control apparatus 30, and the other image processing apparatus40.

Further, according to this embodiment, the same IP address can be set inthe plurality of p-th communication connecting units 41 p. An IP addressdifferent from the IP address of the p-th communication connecting units41 p can be set in the other q-th communication connecting units 41 q.As a result, according to this embodiment, since a degree of freedom ofthe control program and connection of the apparatuses increases, it ispossible to improve convenience.

Third Embodiment

An embodiment of the invention is explained below with reference to thedrawings. Note that components same as the components in the firstembodiment are denoted by the same reference numerals and signs andexplanation of the components is omitted or simplified.

The information processing apparatus 5 shown in FIG. 1 receivesoperation from the user via the GUI displayed on the display unit andoutputs the object code of information processing apparatus 5 to thecontrol apparatus 30 on the basis of the received operation. Forexample, a plurality of processing procedures are described in theobject code. In a processing procedure in which an apparatus executingthe object code performs communication with an external apparatus, foreach kind of processing, information indicating a transmission source ofa request for the processing (the apparatus executing the object code)and information indicating a transmission destination of information(the external apparatus) are described in association with each other.The information indicating the transmission destination is an IP addressset in the control apparatus 30 or an external-communication connectingunit 61 (FIG. 15) of an image processing apparatus 40A.

The information processing apparatus 5 is communicably connected to thecontrol apparatus 30 by a cable. Wired communication via the cable isperformed according to a standard such as the Ethernet (registeredtrademark).

The image pickup apparatus 10 is communicably connected to the imageprocessing apparatus 40A by a cable. Wired communication via the cableis performed, for example, according to a standard such as GigE (GigaEthernet (registered trademark)) in which electric power can be suppliedto the image pickup apparatus 10 through a LAN cable. Note that thecommunication of the image pickup apparatus 10 and the image processingapparatus 40A may be performed according to a standard such as theEthernet (registered trademark). In this case, electric power may beseparately supplied to the image pickup apparatus 10.

The control apparatus 30 outputs, to the information processingapparatus 5, the information indicating the setting concerningrespective networks of the external-communication connecting unit 61(FIG. 15) and the image pickup apparatus 10 output from the imageprocessing apparatus 40A at the start of the image processing apparatus40A. The control apparatus 30 shares the information with theinformation processing apparatus 5.

When the image processing apparatus 40A is started, the image processingapparatus 40A recognizes the image pickup apparatus 10 connected to animage-pickup-apparatus connecting unit 68 (FIG. 15). Note that, in theexternal-communication connecting unit 61 (FIG. 15), as explained below,an IP address (third setting information) is initially set. In theimage-pickup-apparatus connecting unit 68, as explained below, an IPaddress (first setting information) is initially set. When the imageprocessing apparatus 40A can recognize the image pickup apparatus 10,the image processing apparatus 40A acquires an IP address (secondsetting information) set in the image pickup apparatus 10. The imageprocessing apparatus 40A compares the acquired second settinginformation and the first setting information and determines whether itis necessary to change the second setting information. When determiningthat it is necessary to change the second setting information, the imageprocessing apparatus 40A changes the second setting information on thebasis of changing rules explained below. Note that the initial settingsmay be optionally set by the user.

The image processing apparatus 40A outputs the information indicatingthe setting of concerning a network for the external-communicationconnecting unit 61 (FIG. 15), the first setting information, and thesecond setting information to the control apparatus 30.

The schematic configuration of the image processing apparatus 40A isexplained.

FIG. 15 is a schematic block diagram showing the configuration of theimage processing apparatus 40A according to this embodiment. As shown inFIG. 15, the image processing apparatus 40A includes anexternal-communication connecting unit 61, an external communicationunit 62, the input receiving unit 43, the control unit 44, the storingunit 45, the image processing unit 46, an image-pickup-apparatus controlunit 67, an image-pickup-apparatus connecting unit 68 (a connectingunit), and an image-pickup-apparatus communication unit 69. Theimage-pickup-apparatus connecting unit 68 includes a firstimage-pickup-apparatus connecting unit 681 to a fourthimage-pickup-apparatus connecting unit 684. Note that, in thisembodiment, n-th image-pickup-apparatus connecting units 68 n (n isintegers 1 to 4) are referred to as image pickup apparatus ports aswell. The image-pickup-apparatus communication unit 69 includes anacquiring unit 491, a determining unit 492, and a changing unit 493. Thedisplay unit 50 and the input unit 60 are connected to the imageprocessing apparatus 40A.

A LAN cable is connected to the external-communication connecting unit61. The external-communication connecting unit 61 includes a LANconnector. In the external-communication connecting unit 61, an IPaddress is initially set.

The external-communication connecting unit 61 outputs a request receivedfrom the control apparatus 30 via the LAN cable to the externalcommunication unit 62. The external-communication connecting unit 61transmits, according to the control by the external communication unit62, an image processing result and image information output by theexternal communication unit 62 to the control apparatus 30 via the LANcable. Note that the request received by the external-communicationconnecting unit 61 and the image processing result and the imageinformation transmitted by the external-communication connecting unitinclude information indicating a transmission destination andinformation indicating a transmission source.

When the image processing apparatus 40A is started, the externalcommunication unit 62 acquires and shares an IP address of an externalapparatus connected via the LAN cable and the external-communicationconnecting unit 61. The external apparatus is any one of the informationprocessing apparatus 5, the robot 20, the control apparatus 30, andother image processing apparatuses 40A.

The external communication unit 62 receives the request output by theexternal-communication connecting unit 61. The external communicationunit 62 extracts the information indicating the transmission destinationincluded in the received request. The external communication unit 62discriminates whether the information indicating the transmissiondestination of the extracted request and information indicating IPaddresses respectively set in the external-communication connecting unit61 and the image-pickup-apparatus connecting unit 68 coincide with eachother. When the information indicating the transmission destination ofthe extracted request and the IP address set in theexternal-communication connecting unit 61 or the image-pickup-apparatusconnecting unit 68 coincide with each other, the external communicationunit outputs the received request and the information indicating thetransmission destination to the control unit 44.

The external communication unit 62 outputs, to the transmissiondestination included in the image processing result and the imageinformation output by the control unit 44, the image processing resultand the image information via the LAN cable.

The request output by the external communication unit 62, operationinformation output by the input receiving unit 43, and the imageprocessing result output by the image processing unit 46 are input tothe control unit 44. When the request output by the externalcommunication unit 62 is a request for image processing and an imagepickup apparatus, the control unit 44 outputs the input request to theimage processing unit 46.

The image processing result output by the image processing unit 46 andimage information of a picked-up image are input to the control unit 44.The image processing result includes information indicating the positionand the posture of the work target M. The control unit 44 adds theinformation indicating the transmission source of the request includedin the request to the image processing result output by the imageprocessing unit 46 and outputs the image processing result to theexternal communication unit 62. The control unit 44 adds the informationindicating the transmission source of the request included in therequest to the image information output by the image processing unit 46and outputs to the external communication unit 62.

In the storing unit 45, a control program for the control unit 44 tocontrol the units of the image processing apparatus 40A is stored. Inthe storing unit 45, an IP address, for example, “192. 168. 0. 3”allocated in advance to the external-communication connecting unit 61 isstored. In the storing unit 45, IP addresses allocated in advance to thefirst to fourth image-pickup-apparatus connecting units 681 to 684 shownin FIG. 17 are stored. In the storing unit 45, IP addresses allocated inadvance to the image pickup apparatuses 10-1 to 10-4 connected to thefirst to fourth image-pickup-apparatus connecting units 681 to 684 shownin FIG. 18 are stored.

A network segment is explained with reference to FIG. 16.

FIG. 16 is a diagram for explaining a network segment according to thisembodiment. In FIG. 16, “192. 168. 11. 11” indicated by reference signg21 is an example of the IP address. “192” indicated by reference signg1 is referred to as first segment, “168” indicated by reference sign g2is referred to as second segment, “11” indicated by reference sign g3 isreferred to as third segment, and “11” indicated by reference sign g4 isreferred to as fourth segment (host section or host address). The firstsegment to the third segment “192. 168. 11” indicated by reference signg11 is referred to as network segment (network section or networkaddress).

FIG. 17 is a diagram for explaining an example of a relation between IPaddresses and network segments allocated in advance to the first tofourth image-pickup-apparatus connecting units 681 to 684 stored in thestoring unit 45 according to this embodiment. In the example shown inFIG. 17, the IP address allocated to the first image-pickup-apparatusconnecting unit 681 is “192. 168. 11. 1” and the network segment is“192. 168. 11”. The IP address allocated to the secondimage-pickup-apparatus connecting unit 682 is “192. 168. 12. 1” and thenetwork segment is “192. 168. 12”. The IP address allocated to the thirdimage-pickup-apparatus connecting unit 683 is “192. 168. 13. 1” and thenetwork segment is “192. 168. 13”. The IP address allocated to thefourth image-pickup-apparatus connecting unit 684 is “192. 168. 14. 1”and the network segment is “192. 168. 14”. In the example shown in FIG.17, the network segments in the IP addresses allocated in advance to thefirst to fourth image-pickup-apparatus connecting units 681 to 684 areset to be different from a network segment allocated in advance to theexternal-communication connecting unit 61. The network segments of thefirst to fourth image-pickup-apparatus connecting units 681 to 684 arealso set to be different from one another.

FIG. 18 is a diagram for explaining an example of IP addresses allocatedin advance to the image pickup apparatuses 10-1 to 10-4 connected to thefirst to fourth image-pickup-apparatus connecting units 681 to 684 andstored in the storing unit 45 according to this embodiment. In theexample shown in FIG. 18, the IP address allocated to the image pickupapparatus 10-1 connected to the first image-pickup-apparatus connectingunit 681 is “192. 168. 11. 11”. The IP address allocated to the imagepickup apparatus 10-2 connected to the second image-pickup-apparatusconnecting unit 682 is “192. 168. 12. 11”. The IP address allocated tothe image pickup apparatus 10-3 connected to the thirdimage-pickup-apparatus connecting unit 683 is “192. 168. 13. 11”. The IPaddress allocated to the image pickup apparatus 10-4 connected to thefourth image-pickup-apparatus connecting unit 684 is “192. 168. 14. 11”.As shown in FIG. 18, network segments of the IP addresses allocated inadvance to the image pickup apparatuses 10-1 to 10-4 connected to thefirst to fourth image-pickup-apparatus connecting units 681 to 684coincide with the network segments of the first image-pickup-apparatusconnecting unit 681 to the fourth image-pickup-apparatus connecting unit684. Only values of the fourth segments of the network segments are setto be different.

Referring back to FIG. 15, the explanation of the image processingapparatus 40A is continued.

The image processing unit 46 applies, according to the request inputfrom the control unit 44, image processing to the image informationoutput by the image-pickup-apparatus control unit 67 using a well-knownmethod and calculates a position and a posture of the work target M. Theimage processing unit 46 outputs information indicating the calculatedposition and the calculated posture of the work target M to the controlunit 44. When a request to the image-pickup-apparatus control unit 67 isincluded in the information output by the control unit 44, the imageprocessing unit 46 outputs the request to the image-pickup-apparatuscontrol unit 67. The image processing unit 46 outputs the imageinformation output by the image-pickup-apparatus control unit 67 to thecontrol unit 44.

The image-pickup-apparatus control unit 67 selects, according to therequest input from the image processing unit 46, image information inputfrom the image-pickup-apparatus communication unit 69 and outputs theselected image information to the image processing unit 46. Note thatthe image-pickup-apparatus control unit 67 may control, according to therequest input from the image processing unit 46, via theimage-pickup-apparatus communication unit 69 and theimage-pickup-apparatus connecting unit 68, sensitivity of image pickupof the image pickup apparatuses 10-1 to 10-4, selection of a region forthe image pickup, an angle of view of the image pickup, and the like.

The first to fourth image-pickup-apparatus connecting units 681 to 684respectively supply electric power to the image pickup apparatuses 10-1to 10-4. The first to fourth image-pickup-apparatus connecting units 681to 684 include, for example, connectors of the PoE (Power Over Ethernet(registered trademark)) standard. The IP addresses shown in FIG. 17 arerespectively set in advance in the first to fourthimage-pickup-apparatus connecting units 681 to 684.

The image pickup apparatus 10-1 is connected to the firstimage-pickup-apparatus connecting unit 681. The firstimage-pickup-apparatus connecting unit 681 acquires image informationoutput by the image pickup apparatus 10-1 and outputs the acquired imageinformation to the image-pickup-apparatus communication unit 69.

The image pickup apparatus 10-2 is connected to the secondimage-pickup-apparatus connecting unit 682. The secondimage-pickup-apparatus connecting unit 682 acquires image informationoutput by the image pickup apparatus 10-2 and outputs the acquired imageinformation to the image-pickup-apparatus communication unit 69.

The image pickup apparatus 10-3 is connected to the thirdimage-pickup-apparatus connecting unit 683. The thirdimage-pickup-apparatus connecting unit 683 acquires image informationoutput by the image pickup apparatus 10-3 and outputs the acquired imageinformation to the image-pickup-apparatus communication unit 69.

The image pickup apparatus 10-4 is connected to the fourthimage-pickup-apparatus connecting unit 684. The fourthimage-pickup-apparatus connecting unit 684 acquires image informationoutput by the image pickup apparatus 10-4 and outputs the acquired imageinformation to the image-pickup-apparatus communication unit 69. Notethat the image information includes image pickup apparatusidentification information indicating the image pickup apparatuses 10-n(n is integers 1 to 4).

Note that the image pickup apparatus identification information includesinformation indicating the IP addresses respectively set in advance inthe image pickup apparatuses 10-1 to 10-4 as shown in FIG. 18. However,IP addresses are not set in some of the image pickup apparatuses 10-1 to10-4 in an initial state. When IP addresses are not set and when IPaddresses are different from the IP addresses set in advance, theimage-pickup-apparatus communication unit 69 changes or sets the IPaddresses.

When a power supply of the image processing apparatus 40A is turned on,the acquiring unit 491 detects the image pickup apparatuses 10-1 to 10-4respectively connected to the first to fourth image-pickup-apparatusconnecting units 681 to 684. Thereafter, the acquiring unit 491 acquiresthe IP addresses (first setting information) of the respective first tofourth image-pickup-apparatus connecting units 681 to 684 and the IPaddresses (second setting information) of the respective detected imagepickup apparatuses 10-1 to 10-4. The acquiring unit 491 outputs theacquired IP addresses of the respective first to fourthimage-pickup-apparatus connecting units 681 to 684 and the acquired IPaddresses of the respective image pickup apparatuses 10-1 to 10-4 to thedetermining unit 492.

The determining unit 492 compares the IP addresses of the respectivefirst to fourth image-pickup-apparatus connecting units 681 to 684output by the acquiring unit 491 and the IP addresses of the respectiveimage pickup apparatuses 10-1 to 10-4 output by the acquiring unit 491and determines whether it is necessary to change the IP addresses of therespective image pickup apparatuses 10-1 to 10-4. When determining thatit is necessary to change the IP addresses, the determining unit 492outputs the acquired IP addresses of the respective first to fourthimage-pickup-apparatus connecting units 681 to 684 and the acquired IPaddresses of the respective image pickup apparatuses 10-1 to 10-4 to thechanging unit 493.

The IP addresses of the respective first to fourthimage-pickup-apparatus connecting units 681 to 684 and the IP addressesof the respective image pickup apparatuses 10-1 to 10-4 are input to thechanging unit 493 from the determining unit 492. The changing unit 493changes the IP address of the image pickup apparatus 10 that needs to bechanged and causes the storing unit 45 to store the changed IP address.The changing unit 493 transmits information indicating the changed IPaddress to the image pickup apparatus 10 via the image-pickup-apparatusconnecting unit 68 and the LAN cable. Consequently, the changing unit493 sets or changes the IP address of the image pickup apparatus 10.

Processing performed by the image-pickup-apparatus communication unit 69is explained.

Note that, in the following explanation, when one of the first to fourthimage-pickup-apparatus connecting units 681 to 684 is not specified, thefirst to fourth image-pickup-apparatus connecting units 681 to 684 arereferred to as n-th image-pickup-apparatus connecting units 68 n (n isintegers 1 to 4). When one of the image pickup apparatuses 10-1 to 10-4is not specified, the image pickup apparatuses 10-1 to 10-4 are referredto as image pickup apparatuses 10-n (n is integers 1 to 4).

FIG. 19 is a flowchart of a processing procedure performed by theimage-pickup-apparatus communication unit 69 according to thisembodiment.

(Step S21) When the power supply of the image processing apparatus 40Ais turned on, the acquiring unit 491 detects the image pickupapparatuses 10-n respectively connected to the n-thimage-pickup-apparatus connecting units 68 n.

(Step S22) The acquiring unit 491 acquires IP addresses of therespective n-th image-pickup-apparatus connecting units 68 n and IPaddresses of the detected image pickup apparatuses 10-n. Subsequently,the acquiring unit 491 extracts network segments respectively from theIP addresses of the respective n-th image-pickup-apparatus connectingunits 68 n. Subsequently, the acquiring unit 491 extracts networksegments respectively from the IP addresses of the respective detectedimage pickup apparatuses 10-n.

(Step S23) The determining unit 492 compares the network segments of therespective n-th image-pickup-apparatus connecting units 68 n output bythe acquiring unit 491 and the network segments of the respective imagepickup apparatuses 10-n and determines whether the network segments arethe same. When determining that the network segments are the same (YESin step S23), the determining unit 492 proceeds to step S24. Whendetermining that the network segments are different (NO in step S23),the determining unit 492 proceeds to step S27.

(Step S24) The determining unit 492 compares the IP addresses of therespective n-th image-pickup-apparatus connecting units 68 n and the IPaddresses of the respective image pickup apparatuses 10-n and determineswhether the IP addresses are the same. When determining that the IPaddresses are the same (YES in step S24), the determining unit 492proceeds to step S25. When determining that the IP addresses aredifferent (NO in step S24), the determining unit 492 proceeds to stepS26.

(Step S25) The changing unit 493 changes the IP addresses of the imagepickup apparatuses 10-n, the IP addresses of which are same as the IPaddresses of the n-th image-pickup-apparatus connecting units 68 n, toIP addresses (for example, set in advance). In this case, the changingunit 493 does not change the network segments and changes only thefourth segments to change the IP addresses. The changing unit 493 endsthe processing after the change.

(Step S26) The changing unit 493 ends the processing without changingthe IP addresses of the image pickup apparatuses 10-n.

(Step S27) The changing unit 493 changes the IP addresses of the imagepickup apparatuses 10-n, the network segments of which are differentfrom the network segments of the n-th image-pickup-apparatus connectingunits 68 n, to network segments and IP addresses (for example, set inadvance). The changing unit 493 ends the processing after the change.

The processing performed by the image-pickup-apparatus communicationunit 69 ends.

Example of change 1 of an address

An example of processing performed when the network segments of the n-thimage-pickup-apparatus connecting unit 68 n and the image pickupapparatus 10-n are different is explained. In this example, settingconcerning a network for the external-communication connecting unit 61of the image processing apparatus 40A is performed in advance. Thesetting concerning a network is setting of an IP address, an IP addresssub-network mask, an address of a gateway, and the like. In thisexample, an IP address “192. 168. 0. 3” different from the networksegments of the n-th image-pickup-apparatus connecting unit 68 n and theimage pickup apparatus 10-n is set in advance in theexternal-communication connecting unit 61.

FIG. 20 is a diagram for explaining an example of network segments andIP addresses in which the network segments are different in the n-thimage-pickup-apparatus connecting unit 68 n and the image pickupapparatus 10-n according to the this embodiment.

A diagram of a region indicated by reference sign g101 in FIG. 20 is adiagram for explaining acquired network segments and IP addresses of then-th image-pickup-apparatus connecting unit 68 n and the image pickupapparatus 10-n. A diagram of a region indicated by reference sign g111of FIG. 20 is a diagram for explaining a change of the network segmentand the IP address of the image pickup apparatus 10-n.

In an example indicated by reference sign g101 in FIG. 20, the networksegment of the n-th image-pickup-apparatus connecting unit 68 n is “192.168. 11” and the IP address of the n-th image-pickup-apparatusconnecting unit 68 n is “192. 168. 11. 1”. The network segment of theimage pickup apparatus 10-n connected to the n-th image-pickup-apparatusconnecting unit 68 n is “192. 168. 50” and the IP address of the imagepickup apparatus 10-n is “192. 168. 50. 1”.

In the example indicated by reference sign g101 in FIG. 20, the networksegments of the n-th image-pickup-apparatus connecting unit 68 n and theimage pickup apparatus 10-n are different. Therefore, the networksegment and the IP address of the image pickup apparatus 10-n arechanged by the changing unit 493 to values set in advance as shown inregions indicated by reference signs g111 and g112 in FIG. 20.Specifically, the network segment “192. 168. 50” of the image pickupapparatus 10-n is changed to the network segment “192. 168. 11” of then-th image-pickup-apparatus connecting unit 68 n by the changing unit493. Thereafter, the fourth segment of the IP address of the imagepickup apparatus 10-n is changed to “192. 168. 11. 11”, which is a valuedecided in advance, by the changing unit 493.

Example of change 2 of an address

An example of processing performed when the network segments and IPaddresses of the n-th image-pickup-apparatus connecting unit 68 n andthe image pickup apparatus 10-n are the same is explained. In thisexample as well, the IP address “192. 168. 0. 3” is set in advance inthe external-communication connecting unit 61.

FIG. 21 is a diagram for explaining an example of network segments andIP addresses in which the network segments and the IP addresses are thesame in the n-th image-pickup-apparatus connecting unit 68 n and theimage pickup apparatus 10-n according to the this embodiment.

A diagram of a region indicated by reference sign g121 in FIG. 21 is adiagram for explaining acquired network segments and IP addresses of then-th image-pickup-apparatus connecting unit 68 n and the image pickupapparatus 10-n. A diagram of a region indicated by reference sign g131of FIG. 21 is a diagram for explaining a change of the IP address of theimage pickup apparatus 10-n.

In an example indicated by reference sign g121 in FIG. 21, the networksegment of the n-th image-pickup-apparatus connecting unit 68 n is “192.168. 11” and the IP address of the n-th image-pickup-apparatusconnecting unit 68 n is “192. 168. 11. 1”. The network segment of theimage pickup apparatus 10-n connected to the n-th image-pickup-apparatusconnecting unit 68 n is “192. 168. 11” and the IP address of the imagepickup apparatus 10-n is “192. 168. 11. 1”.

In the example indicated by reference sign g121 in FIG. 21, the networksegments of the n-th image-pickup-apparatus connecting unit 68 n and theimage pickup apparatus 10-n are the same. Therefore, the network segmentand the IP address of the image pickup apparatus 10-n are changed by thechanging unit 493 to values set in advance from a region indicated byreference sign g122 to a region indicated by reference sign g132 in FIG.21. Specifically, the fourth segment of the IP address of the imagepickup apparatus 10-n is changed to “192. 168. 11. 11”, which is a valuedecided in advance, by the changing unit 493.

Note that “11” of the fourth segment of the IP address of the imagepickup apparatus 10-n explained with reference to FIGS. 20 and 21 is anexample. A value decided in advance of the fourth segment only has to bedifferent from a value of the fourth segment of the IP address of then-th image-pickup-apparatus connecting unit 68 n. For example, the valueof the fourth segment of the IP address of the image pickup apparatus10-n may be allocated by the changing unit 493 at random or in order.For example, when it is determined that the value of the fourth segmentof the IP address of the image pickup apparatus 10-n after the change isthe same as the value of the fourth segment of the IP address of then-th image-pickup-apparatus connecting unit 68 n, the value may befurther changed to be a value different from the value of the fourthsegment of the IP address of the n-th image-pickup-apparatus connectingunit 68 n.

The image processing apparatus 40A and the robot system 1 in thisembodiment explained above determine, using network setting informationof the image pickup apparatus 10-n and network setting information ofthe n-th image-pickup-apparatus connecting unit 68 n to which the imagepickup apparatus 10-n are connected, whether it is necessary to changethe network setting information of the image pickup apparatus 10-n. Whenit is necessary to change the network setting information of the imagepickup apparatus 10-n, the image processing apparatus 40A and the robotsystem 1 in this embodiment change the network setting information ofthe image pickup apparatus 10-n. Therefore, it is possible toautomatically perform setting concerning a network for the image pickupapparatus 10-n.

Consequently, the user can use the robot system 1 without being aware ofthe setting of the image pickup apparatus 10-n connected to the imageprocessing apparatus 40A and the n-th image-pickup-apparatus connectingunit 68 n to which the image pickup apparatus 10-n is connected. When aplurality of image pickup apparatuses 10-n are used, the imageprocessing apparatus 40A automatically performs setting for each of theimage pickup apparatuses 10-n. Therefore, it is possible to reduce laborof the user for setting concerning a network.

Further, according to this embodiment, for example, image pickupapparatuses connected to other robot systems and other image processingapparatuses and used are connected to the image processing apparatus 40Ain this embodiment. Then, the image processing apparatus 40Aautomatically performs the setting for each of the image pickupapparatuses 10-n. As a result, according to this embodiment, it ispossible to automatically perform the setting for each of the imagepickup apparatuses 10-n irrespective of the IP addresses set in theimage pickup apparatuses 10-n connected to the image processingapparatus 40A. In this way, simply by connecting the image pickupapparatuses 10-n to the image processing apparatus 40A, the user can usethe image pickup apparatuses 10-n in the image processing apparatus 40Awithout performing setting concerning a network.

Fourth Embodiment

In the third embodiment, the example is explained in which the settingconcerning a network for the external-communication connecting unit 61of the image processing apparatus 40A is performed in advance.

In this embodiment, an IP address of the external-communicationconnecting unit 61 is changed by, for example, a user. Note that theconfiguration of the image processing apparatus 40A is the same as theconfiguration shown in FIG. 15 in the third embodiment.

FIG. 22 is a flowchart of a processing procedure performed by theimage-pickup-apparatus communication unit according to this embodiment.Note that, in the following explanation, it is assumed that networksegments respectively set in the n-th image-pickup-apparatus connectingunits 68 n and the image pickup apparatuses 10-n are the same and IPaddresses respectively set in the n-th image-pickup-apparatus connectingunits 68 n and the image pickup apparatuses 10-n are different.

(Step S31) When the power supply of the image processing apparatus 40Ais turned on, the acquiring unit 491 acquires network segmentsrespectively set in the external-communication connecting unit 61, then-th image-pickup-apparatus connecting units 68 n, and the image pickupapparatuses 10-n.

(Step S32) The determining unit 492 determines whether the networksegment of the external-communication connecting unit 61 is the same asthe network segment of the n-th image-pickup-apparatus connecting units68 n. When determining that the network segment of theexternal-communication connecting unit 61 and the network segment of then-th image-pickup-apparatus connecting units 68 n are the same (YES instep S32), the determining unit 492 proceeds to step S33. Whendetermining that the network segment of the external-communicationconnecting unit 61 and the network segment of the n-thimage-pickup-apparatus connecting units 68 n are different (NO in stepS32), the determining unit 492 ends the processing without changing theIP respective addresses of the n-th image-pickup-apparatus connectingunit 68 n and the image pickup apparatus 10-n.

(Step S33) The changing unit 493 applies, to the n-thimage-pickup-apparatus connecting units 68 n, processing for changingthe network segment of the n-th image-pickup-apparatus connecting units68 n to a network segment different from the network segment of theexternal-communication connecting unit 61. The changing unit 493 sets(changes), as a new network segment of the n-th image-pickup-apparatusconnecting units 68 n, for example, a value obtained by adding 10 to avalue of a third segment of the network segment of theexternal-communication connecting unit 61. Subsequently, the changingunit 493 changes the network segment of the image pickup apparatuses10-n to a network segment same as the network segment set anew in then-th image-pickup-apparatus connecting units 68 n.

A specific example of processing performed by the image-pickup-apparatuscommunication unit 69 when the IP address of the external-communicationconnecting unit 61 is changed by the user is explained.

FIG. 23 is a diagram for explaining an example of network segments andIP addresses in which the network segments are the same in theexternal-communication connecting unit 61, the n-thimage-pickup-apparatus connecting unit 68 n, and the image pickupapparatus 10-n according to this embodiment.

A diagram of a region indicated by reference sign g141 in FIG. 23 is adiagram for explaining acquired network segments and IP addresses of theexternal-communication connecting unit 61, the n-thimage-pickup-apparatus connecting unit 68 n, and the image pickupapparatus 10-n. A diagram of a region indicated by reference sign g151of FIG. 23 is a diagram for explaining a change of the network segmentsof the n-th image-pickup-apparatus connecting unit 68 n and the imagepickup apparatus 10-n.

In an example indicated by reference sign g141 in FIG. 23, the networksegment of the external-communication connecting unit 61 is “192. 168.11” and the IP address of the external-communication connecting unit 61is “192. 168. 11. 3”. The network segment of the n-thimage-pickup-apparatus connecting unit 68 n is “192. 168. 11” and the IPaddress of the n-th image-pickup-apparatus connecting unit 68 n is “192.168. 11. 1”. The network segment of the image pickup apparatus 10-nconnected to the n-th image-pickup-apparatus connecting unit 68 n is“192. 168. 11” and the IP address of the image pickup apparatus 10-n is“192. 168. 11. 11”.

In the example indicated by reference sign g141 in FIG. 23, the networksegment of the external-communication connecting unit 61 is the same asthe network segments of the n-th image-pickup-apparatus connecting unit68 n and the image pickup apparatus 10-n. Therefore, the network segmentof the n-th image-pickup-apparatus connecting unit 68 n is changed to avalue “192. 168. 21”, which is obtained by adding 10 to a value of thenetwork segment of the external-communication connecting unit 61, by thechanging unit 493 from a region indicated by reference sign g142 to aregion indicated by reference sign g152 in FIG. 23. In this case, thefourth segment “1” is not changed from the region indicated by referencesign g142 to the region indicated by reference sign g152 in FIG. 23.

Further, the network segment of the image pickup apparatus 10-n ischanged to a value same as a network segment set anew in the n-thimage-pickup-apparatus connecting unit 68 n by the changing unit 493from a region indicated by reference sign g143 to a region indicated byreference sign g153 in FIG. 23. In this case, the fourth segment “11” isnot changed from the region indicated by reference sign g143 to theregion indicated by reference sign g153 in FIG. 23.

As explained above, according to this embodiment, the setting of thenetwork segments of the n-th image-pickup-apparatus connecting unit 68 nand the image pickup apparatus 10-n is dynamically changed according tothe setting concerning a network for the external-communicationconnecting unit 61. Consequently, even when the setting concerning anetwork for the external-communication connecting unit 61 is changed bythe user, the user does not have to change the IP addresses of the n-thimage-pickup-apparatus connecting unit 68 n and the image pickupapparatus 10-n. As a result, according to this embodiment, in the imageprocessing apparatus 40A, it is possible to automatically set the IPaddress of the n-th image-pickup-apparatus connecting unit 68 n to whichthe image pickup apparatus 10 is connected and the IP address of theimage pickup apparatus 10.

Even when the IP address of the external-communication connecting unit61 of the image processing apparatus 40A is changed, the imageprocessing apparatus 40A and the robot system 1 according to theembodiment explained above determine, using network setting informationof the external-communication connecting unit 61 and the network settinginformation of the image pickup apparatuses 10-n, whether it isnecessary to change the network setting information of the image pickupapparatuses 10-n. When it is necessary to change the network settinginformation of the image pickup apparatuses 10-n, the image processingapparatus 40A and the robot system 1 in this embodiment change thenetwork setting information of the image pickup apparatuses 10-n.Therefore, it is possible to automatically perform setting concerning anetwork for the image pickup apparatuses 10-n.

Note that, in this embodiment, the example is explained in which theimage processing apparatus 40A includes the four n-thimage-pickup-apparatus connecting units 68 n. However, the number ofn-th image-pickup-apparatus connecting units 68 n only has to be one ormore.

In this embodiment, the example is explained in which the imageprocessing apparatus 40A includes the one external-communicationconnecting unit 61. However, the number of external-communicationconnecting units 61 may be two or more.

Fifth Embodiment

An embodiment of the invention is explained below with reference to thedrawings. Note that components same as the components in the firstembodiment are denoted by the same reference numerals and signs andexplanation of the components is omitted or simplified.

The information processing apparatus 5 shown in FIG. 1 is communicablyconnected to the control apparatus 30 by a cable. Wired communicationvia a cable is performed, for example, according to a standard such asthe Ethernet (registered trademark) or the USB. Note that theinformation processing apparatus 5 and the control apparatus may beconnected by radio communication performed according to a communicationstandard such as the Wi-Fi (registered trademark).

In the following explanation, a reset function and a data savingfunction of an image processing apparatus 40B in the robot system 1configured as explained above are explained. The reset function of theimage processing apparatus 40B indicates, for example, a function ofrestoring the image processing apparatus 40B to a predetermined stateand indicates, for example, a function of restoring the image processingapparatus 40B to, for example, a state at the time of factory shipment.The data saving function of the image processing apparatus 40B indicatesa function of causing a storing unit separate from the image processingapparatus 40B (detachably attachable to the image processing apparatus40B) to store (save) at least a part of data concerning the imageprocessing apparatus 40B stored in a storing unit that stores the dataconcerning the image processing apparatus 40B.

The hardware configuration of the image processing apparatus 40B isexplained with reference to FIG. 24.

FIG. 24 is a diagram showing an example of the hardware configuration ofthe image processing apparatus 40B according to this embodiment. Theimage processing apparatus 40B includes, for example, a CPU (CentralProcessing Unit) 71, a storing unit 72, the input receiving unit 43, acommunication unit 74, an output unit 75, and a detecting unit 76. Theimage processing apparatus 40B performs communication with the controlapparatus 30, other image processing apparatuses 40B, other apparatuses,and the like via the communication unit 74. These components arecommunicably connected to one another via a bus Bus. The CPU 71 executesvarious kinds of computer programs stored in the storing unit 72.

The storing unit 72 includes a memory 421 and a storage 422.

The memory 421 includes, for example, a DRAM (Dynamic Random AccessMemory) or an SRAM (Static Random Access Memory). The memory 421 is astorage device directly accessible by mainly a processor such as the CPU71 among functional units of the image processing apparatus 40B.

The storage 422 includes, for example, a HDD (Hard Disk Drive), an SSD(Solid State Drive), an EEPROM (Electrically Erasable ProgrammableRead-Only Memory), a ROM (Read-Only Memory), or a RAM (Random AccessMemory). The storage 422 stores various kinds of information, images,computer programs, and the like to be processed by the image processingapparatus 40B.

An external storage 423 is an external storage device connected by, forexample, a digital input/output port such as a USB.

Note that, like the external storage 423, the memory 421 and the storage422 may be respectively external storage devices connected by, forexample, a digital input/output port such as a USB instead of storagedevices incorporated in the image processing apparatus 40B.

The input receiving unit 43 is, for example, one or more buttons capableof inputting a plurality of requests to the image processing apparatus40B, for example, by being depressed or pressed for a long time.However, instead, the input receiving unit 43 may be a switch capable ofselecting three or more states or may be a keyboard, a mouse, a touchpad, or other input devices. In that case, the input receiving unit 43may be configured integrally with a display unit as a touch panel. Inthis example, the input receiving unit 43 is explained as one button.

The communication unit 74 includes an external communication unit 441, afirst image-pickup communication unit 442, and a second image-pickupcommunication unit 443.

The external communication unit 441 includes, for example, digitalinput/output ports such as a plurality of Ethernet (registeredtrademark) ports or a plurality of USBs. In the explanation of thisexample, it is assumed that the external communication unit 441 includestwo Ethernet (registered trademark) ports.

The first image-pickup communication unit 442 includes digitalinput/output ports such as a plurality of Ethernet (registeredtrademark) ports or a plurality of USBs. The ports are dedicated portsfor performing communication with the image pickup apparatus 10. Notethat the first image-pickup communication unit 442 may be a dedicatedport for performing communication with other apparatuses such as a soundacquiring apparatus for acquiring sound.

The second image-pickup communication unit 443 includes digitalinput/output ports such as a plurality of Ethernet (registeredtrademark) ports or a plurality of USBs. The ports are dedicated portsfor performing communication with the image pickup apparatus 10. Notethat the second image-pickup communication unit 443 may be a dedicatedport for performing communication with other apparatuses such as a soundacquiring apparatus for acquiring sound.

The first image-pickup communication unit 442 and the secondimage-pickup communication unit 443 are different in communicationstandards of the ports thereof. In this example, it is assumed that thefirst image-pickup communication unit 442 includes four Ethernet(registered trademark) ports and the second image-pickup communicationunit 443 includes four USB ports.

The output unit 75 includes a plurality of LEDs and notifies variouskinds of information with lighting states (e.g., extinguishing,lighting, and blinking) of the LEDs. In the explanation of this example,it is assumed that the output unit 75 includes one green LED and one redLED. However, colors of the LEDs may be respectively other colors or maybe the same color. Note that, instead of including the LEDs, the outputunit 75 may include, for example, a liquid crystal display panel or anorganic EL (Electro Luminescence) display panel or may include a speakerthat outputs sound. In the following explanation, for convenience ofexplanation, the green LED included in the output unit 75 is referred toas state LED and the red LED included in the output unit 75 is referredto as warning LED.

The detecting unit 76 is a plurality of sensors for detecting physicalquantities serving as indexes indicating states of a respectiveplurality of pieces of hardware included in the image processingapparatus 40B. In this example, the plurality of pieces of hardwareincluded in the image processing apparatus 40B indicate a not-showncooling fan for the CPU 71, a not-shown system fan that cools the insideof a housing of the image processing apparatus 40B, the CPU 71, and anot-shown battery for BIOS (Basic Input Output System) backupincorporated in the image processing apparatus 40B. However, theplurality of pieces of hardware may be combinations of a part of thesepieces of hardware, may be combinations of these pieces of hardware andother pieces of hardware, or may be one or more pieces of otherhardware.

In this example, the physical quantities serving as the indexesindicating the states of the hardware are the number of revolutions ofthe cooling fan for the CPU 71, the number of revolutions of the systemfan that cools the inside of the housing of the image processingapparatus 40B, the temperature of the CPU 71, and a voltage value of thebattery for BIOS backup incorporated in the image processing apparatus40B. However, instead, the physical quantities may be combinations ofthese physical quantities, may be combinations of these physicalquantities and other physical quantities, or may be one or more otherphysical quantities.

In this embodiment, the detecting unit 76 includes, for example, foursensors, i.e., a first detecting unit 461, a second detecting unit 462,a third detecting unit 463, and a fourth detecting unit 464.

The first detecting unit 461 is, for example, a number-of-revolutionssensor that detects the number of revolutions of the cooling fan for theCPU 71.

The second detecting unit 462 is, for example, a number-of-revolutionssensor that detects the number of revolutions of the system fan thatcools the inside of the housing of the image processing apparatus 40B.

The third detecting unit 463 is, for example, a temperature sensor thatdetects the temperature of the CPU 71.

The fourth detecting unit 464 is, for example, a voltage sensor thatdetects the voltage value of the battery for BIOS backup incorporated inthe image processing apparatus 40B.

The functional configuration of the image processing apparatus 40B isexplained with reference to FIG. 25.

FIG. 25 is a diagram showing an example of the functional configurationof the image processing apparatus 40B. The image processing apparatus40B includes the storing unit 72, the communication unit 74, the outputunit 75, the detecting unit 76, and a control unit 77. Note that, in theexplanation of this example, it is assumed that the image pickupapparatus 10 is connected to the first image-pickup communication unit442 and an image pickup apparatus is not connected to the secondimage-pickup communication unit 443.

The control unit 77 controls the entire image processing apparatus 40B.The control unit 77 includes an input determining unit 470, adetection-information acquiring unit 471, a state-information savingunit 472, an initializing unit 473, an output control unit 474, acommunication control unit 475, an image-pickup control unit 476, animage acquiring unit 477, and an image processing unit 478.

A part or all of the functional units included in the control unit 77are realized by, for example, the CPU 71 executing a computer programstored in the storage 422 of the storing unit 72. A part of thefunctional units may be hardware functional units such as an LSI (LargeScale Integration) and an ASIC (Application Specific IntegratedCircuit). Note that the control unit 77 is a part of a processing unit.In the explanation of this example, it is assumed that the image pickupapparatus 10 is connected to the first image-pickup communication unit442 and an image pickup apparatus is not connected to the secondimage-pickup communication unit 443.

The input determining unit 470 determines what kind of operation fromthe user is received by the input receiving unit 43. In this example,the input determining unit 470 determines whether, as time of theoperation from the user received by the input determining unit 470, timefrom depression to release of a button is less than a predetermined timeT1 or the predetermined time T1 or more.

The detection-information acquiring unit 471 cyclically (e.g., everytime one minute elapses) acquires physical quantities respectivelydetected by the first to fourth detecting units 461 to 464 included inthe detecting unit 76. In addition, the detection-information acquiringunit 471 may be configured to cyclically (e.g., every time one minuteelapses) acquire information indicating free capacities of storageregions from the respective memories 421 and the storage 422 included inthe storing unit 72.

In the following explanation, for convenience of explanation, aplurality of physical quantities acquired from the detecting unit 76 arecollectively referred to as detection information. Note that thedetection-information acquiring unit 471 may be configured to continueto always acquire the detection information or may be configured toacquire the detection information at predetermined time instead of beingconfigured to cyclically acquire the detection information. Thedetection-information acquiring unit 471 causes the storage 422 of thestoring unit 72 to store, as history information of hardware monitoring,the detection information acquired from the detecting unit 76.

When the input determining unit 470 determines that the time fromdepression to release of the button of the input receiving unit 43 isless than the predetermined time T1, the state-information saving unit472 determines whether the external storage 423 is connected to theimage processing apparatus 40B. When determining that the externalstorage 423 is connected to the image processing apparatus 40B, thestate-information saving unit 472 causes the external storage 423 tostore (save) a part or all of data concerning the image processingapparatus 40B. On the other hand, when determining that the externalstorage 423 is not connected to the image processing apparatus 40B, thestate-information saving unit 472 stays on standby without performinganything.

When the input determining unit 470 determines that the time fromdepression to release of the button of the input receiving unit 43 isthe predetermined time T1 or more, the initializing unit 473 deletes atleast a part of the data concerning the image processing apparatus 40Bstored in the storage 422.

When the saving of the data concerning the image processing apparatus40B in the external storage 423 is executed by the state-informationsaving unit 472, the output control unit 474 changes an output state (inthis example, a lighting state) of the output unit 75 according tosuccess or failure of the saving.

The communication control unit 475 outputs information indicating aposition and a posture of the work target M calculated by the imageprocessing unit 478 to the control apparatus 30.

The image-pickup control unit 476 controls the image pickup apparatus 10to pick up an image of a range including the work target M via the firstimage-pickup communication unit 442. When some image pickup apparatus Zis connected to the second image-pickup communication unit 443, theimage-pickup control unit 476 controls, via the second image-pickupcommunication unit 443, the image pickup apparatus Z to pick up an imageof a range in which the image pickup apparatus Z can pick up an image.

The image acquiring unit 477 acquires a picked-up image from the imagepickup apparatus 10 via the first image-pickup communication unit 442.When the image pickup apparatus Z is connected to the secondimage-pickup communication unit 443, the image acquiring unit 477acquires a picked-up image from the image pickup apparatus Z via thesecond image-pickup communication unit 443.

The image processing unit 478 performs, on the basis of the picked-upimage acquired by the image acquiring unit 477, image processing forcalculating a position and a posture of the work target M.

Initialization processing and data saving processing for the imageprocessing apparatus 40B performed by the control unit 77 are explainedbelow with reference to FIG. 26.

FIG. 26 is a flowchart for explaining an example of a flow of theinitialization processing and the data saving processing for the imageprocessing apparatus 40B performed by the control unit 77. First, thecontrol unit 77 receives operation from the user with the inputreceiving unit 43 (step S110).

The operation from the operator received from the input receiving unit43 by the control unit 77 indicates that the user depresses and thenreleases the button included in the input receiving unit 43. Note that,in this embodiment, the input receiving unit 43 is configured to receivethe operation from the user at a point in time when the user releasesthe button included in the input receiving unit 43. However, instead,the input receiving unit 43 may be configured to receive the operationfrom the user when an elapsed time in which the user continues todepress the button included in the input receiving unit 43 is apredetermined time T2 or more.

Subsequently, the input determining unit 470 determines whether timefrom depression to release of the button is the predetermined time T1 ormore in the operation (i.e., depression of the button) from the userreceived by the input receiving unit 43 in step S110 (step S120). Thepredetermined time T1 is, for example, ten seconds but may be othertimes. When it is determined that the time from depression to release ofthe button is the predetermined time T1 or more (i.e., the button ispressed for a long time) (Yes in step S120), the initializing unit 473deletes (i.e., initializes) at least a part of the data concerning theimage processing apparatus 40B stored in the storage 422 (step S130),adds the initialization of the image processing apparatus 40B toinformation indicating a history related to the image processingapparatus 40B explained below, and ends the processing. Note that, whenit is determined that the time from depression to release of the buttonis the predetermined time T1 or more (i.e., the button is pressed for along time), for example, a reset signal is input.

Processing by the initializing unit 473 for deleting at least a part ofthe data concerning the image processing apparatus 40B stored in thestorage 422 is explained. In this example, the data concerning the imageprocessing apparatus 40B includes the history information of thehardware monitoring, setting information on the image processingapparatus 40B side corresponding to display content of a GUI displayedon the information processing apparatus 5 (e.g., a type of informationdisplayed on the GUI), information related to image processing performedby the image processing apparatus 40B, and a system (OS) log.

The history information of the hardware monitoring includes, forexample, information indicating histories of the temperature of the CPU71, the number of revolutions of the cooling fan for the CPU 71, thenumber of revolutions of the system fan that cools the inside of thehousing of the image processing apparatus 40B, a voltage value of thebattery for BIOS backup incorporated in the image processing apparatus40B, and the like. The information related to the image processingperformed by the image processing apparatus 40B includes settinginformation of the image pickup apparatus 10, an image processingproject, image data used for executed image processing (e.g., apicked-up image picked up by the image pickup apparatus 10 and an imageacquired from the information processing apparatus 5), and informationindicating a history related to the image processing apparatus 40B.

The setting information of the image pickup apparatus 10 includes, forexample, shutter speed and exposure and the number of times of imagepickup per unit time. The image processing project indicates, forexample, a group of setting information, a computer program, a library,and the like for executing image processing. The information indicatingthe history related to the image processing apparatus 40B includesinformation indicating executed processing, information indicating theorder of the executed processing, information indicating an image pickupapparatus used for the executed processing, information indicatingsuccess or failure of the executed processing, and informationindicating that the image processing apparatus 40B is initialized.

In the initialization processing, for example, the initializing unit 473leaves only the information indicating the history related to the imageprocessing apparatus 40B among the information included in the dataconcerning the image processing apparatus 40B and deletes the otherinformation from the storage 422. By deleting the information other thanthe information indicating the history related to the image processingapparatus 40B from the storage 422 in this way, it is possible to easilyrestore the image processing apparatus 40B to a state at the time offactory shipment (i.e., initialize the image processing apparatus 40B).It is possible to provide the user with the information indicating thehistory related to the image processing apparatus 40B necessary insearching for a cause of a trouble.

Note that the initializing unit 473 may be configured to leave, inaddition to the information indicating the history related to the imageprocessing apparatus 40B, a part of the other information included inthe data concerning the image processing apparatus 40B in the storage422. In that case, the control unit 77 may be configured to receiveoperation from the user with the input receiving unit 43 and selectinformation to be left in the storage 422 from the data concerning theimage processing apparatus 40B on the basis of the received operation ormay be configured to leave, in the storage 422, a combination ofpredetermined information among the information included in the dataconcerning the image processing apparatus 40B. Consequently, instead ofbeing restored to the state at the time of factory shipment, the imageprocessing apparatus 40B can be restored to another predetermined state(e.g., a state immediately after the user performs the setting forperforming the image processing).

In this example, when the button included in the input receiving unit 43continues to be depressed for the predetermined time T1 (e.g., tenseconds) or more by the user, the output control unit 474 controls thestate LED included in the output unit 75 to blink five times (at thispoint, extinguishes the error LED). The predetermined time T1 is anexample of the predetermined time in the aspect of the invention. Whenthe user releases the button while the state LED blinks five times inthis way, the initializing unit 473 executes initialization of the imageprocessing apparatus 40B explained in step S130. Consequently, thecontrol unit 77 can suppress the user from initializing the imageprocessing apparatus 40B by mistake.

Referring back to FIG. 26, when it is determined in step S120 that thetime from depression to release of the button is less than thepredetermined time T1 (i.e., the button is not pressed for a long time)(No in step S120), the state-information saving unit 472 determineswhether the external storage 423 is connected to the image processingapparatus 40B (step S140). Note that, when it is determined that thetime from depression to release of the button is the predetermined timeT1 or less (i.e., the button is not pressed for a long time), forexample, a data saving signal is input. When it is determined that theexternal storage 423 is not connected to the image processing apparatus40B (No in step S140), the control unit 77 returns to step S110 andstays on standby.

On the other hand, when it is determined that the external storage 423is connected to the image processing apparatus 40B (Yes in step S140),the state-information saving unit 472 generates state information on thebasis of the data concerning the image processing apparatus 40B (stepS150). The state information is information obtained by collectivelycompressing the data concerning the image processing apparatus 40B andis, for example, a file compressed on the basis of a ZIP file format orthe like. Note that, in this example, date and time is given to a filename of the state information. However, instead, other file names may beused.

Subsequently, the state-information saving unit 472 saves the stateinformation generated in step S150 in the external storage 423 (stepS160). In the following explanation, for convenience of explanation, itis assumed that the saving of the state information in the externalstorage 423 by the state-information saving unit 472 in step S160 issuccessful. Subsequently, the output control unit 474 performs controlto change the lighting state of the output unit 75 according to successor failure of the saving of the state information in the externalstorage 423 by the state-information saving unit 472 in step S160 (stepS170).

Processing for changing the lighting state of the output unit 75 by theoutput control unit 474 in step S170 is explained with reference to FIG.27.

FIG. 27 is a table showing an example of rules for changing the lightingstate of the output unit 75 by the output control unit 474. The outputcontrol unit 474 changes, on the basis of a correspondence relationshown in FIG. 27, the lighting state of the output unit 75 according tothe success or failure of the saving of the state information in theexternal storage 423 by the state-information saving unit 472 in stepS160.

More specifically, in this embodiment, when the saving of the stateinformation in the external storage 423 by the state-information savingunit 472 in step S160 is successful, the output control unit 474extinguishes the warning LED of the output unit 75 and blinks the stateLED of the output unit 75 at high speed (at an interval of 300 ms). Onthe other hand, when the saving of the state information in the externalstorage 423 by the state-information saving unit 472 in step S160 isunsuccessful, the output control unit 474 blinks the warning LED of theoutput unit 75 at high speed (at an interval of 300 ms) and extinguishesthe state LED of the output unit 75. Consequently, the image processingapparatus 40B can easily notify the user of the success or failure ofthe saving of the state information. Note that the change of thelighting state of the output unit 75 by the output control unit 474 maybe a change to another lighting state instead of the change based on therules shown in FIG. 27.

In step S120 shown in FIG. 26, the input determining unit 470 maydetermine, when the user depresses the button, another state of theoperation by the user, for example, determine timing when the button isdepressed and timing when the button is released. In such aconfiguration, when the timing when the button is released isdetermined, the input determining unit 470 also determines whether thepredetermined time T1 or more has elapsed after the button is depressed.

When the input determining unit 470 is configured as explained above,for example, when the input determining unit 470 determines that thebutton is released and the predetermined time T1 or more has elapsedafter the button is depressed, the initializing unit 473 performs theprocessing in step S130. For example, when the input determining unit470 determines that the button is depressed, the state-informationsaving unit 472 performs the processing in steps S140 to S170.

As explained above, when the reset signal is input (in this example,when the time from depression to release of the button is thepredetermined time T1 or more), the robot system 1 in this embodimentdeletes at least a part of the data related to the image processingapparatus 40B stored in the storage 422 of the storing unit 72.Consequently, the image processing apparatus 40B can be easily restoredto a predetermined state.

When the reset signal is input (in this example, when the time fromdepression to release of the button is the predetermined time T1 ormore), the image processing apparatus 40B deletes at least a part of thehistory information of the hardware monitoring of the image processingapparatus 40B stored in the storage 422 of the storing unit 72, thesetting information on the image processing apparatus 40B sidecorresponding to the display content of the GUI displayed on theinformation processing apparatus 5, the information related to the imageprocessing performed by the image processing apparatus 40B, and a systemlog. Consequently, the image processing apparatus 40B can be restored toa predetermined state based on a part or all of the history informationof the hardware monitoring of the image processing apparatus 40B, thesetting information on the image processing apparatus 40B sidecorresponding to the display content of the GUI displayed on theinformation processing apparatus 5, the information related to the imageprocessing performed by the image processing apparatus 40B, and thesystem log.

When the data saving signal is input (in this example, when the timefrom depression to release of the button is less than the predeterminedtime T1), the image processing apparatus 40B stores, in the externalstorage device (in this example, the external storage 423), at least apart of the data concerning the image processing apparatus 40B stored inthe storage 422 of the storing unit 72. Consequently, the imageprocessing apparatus 40B can cause the user to check a state of theimage processing apparatus 40B on the basis of the data concerning theimage processing apparatus 40B stored in the external storage device.

When a predetermined button among the one or more buttons included inthe input receiving unit 43 is released before the predetermined time T1elapses from the depression of the bottom, the image processingapparatus 40B inputs the data saving signal to the processing unit. Whenthe predetermined button is released after the predetermined time T1 ormore elapses from the depression of the button, the image processingapparatus 40B inputs the reset signal to the control unit 77.Consequently, the image processing apparatus 40B can select, accordingto the time from depression to release of the predetermined button,processing performed by the control unit 77.

When the predetermined button continues to be depressed for thepredetermined time T1 or more, the image processing apparatus 40Bchanges the output state (in this example, the lighting state) of theoutput unit 75 for a predetermined time. Consequently, the imageprocessing apparatus 40B can notify the user whether the predeterminedbutton continues to be depressed for the predetermined time T1 or more.

The image processing apparatus 40B changes the output state (in thisexample, the lighting state) of the output unit 75 according to deletionof at least a part of the data concerning the image processing apparatus40B by the initializing unit 473 or success or failure of storage in theexternal storage device (in this example, the external storage 423) ofat least a part of the data concerning the image processing apparatus40B by the state-information saving unit 472. Consequently, the imageprocessing apparatus 40B can notify the user of the deletion of at leasta part of the data concerning the image processing apparatus 40B by theinitializing unit 473 or the success or failure of storage in theexternal storage device of at least a part of the data concerning theimage processing apparatus 40B by the state-information saving unit 472.

When the external storage device (in this example, the external storage423) is not connected to the image processing apparatus 40B, even whenthe data saving signal is input, the image processing apparatus 40B doesnot perform the storage in the external storage device of at least apart of the data concerning the image processing apparatus 40B.Consequently, the image processing apparatus 40B can suppresscontinuation of the processing of the state-information saving unit 472due to wrong operation in a state in which preparation for causing theexternal storage device to store at least a part of the data concerningthe image processing apparatus 40B is not completed.

Sixth Embodiment

An embodiment of the invention is explained below with reference to thedrawings. In the following explanation, a network means a LAN. Networksegments, which are ranges obtained by logically dividing the LAN, arereferred to as sub-networks. A network address for identifying anapparatus that transmits and receives data on the network is simplyreferred to as address. An IP address is an example of the networkaddress. Note that components same as the components in the firstembodiment are denoted by the same reference numerals and signs andexplanation of the components is omitted or simplified.

FIG. 28 is a configuration diagram showing a robot system 3 according tothis embodiment. The robot system 3 includes an image processing system2, the image pickup apparatus 10, the robot 20, and the controlapparatus 30.

The image processing system 2 includes an image processing apparatus 40Cand the information processing apparatus 5.

The control apparatus 30, the image processing apparatus 40C, and theinformation processing apparatus 5 are communicably connected via anetwork 90. The network 90 may be a wired network or may be a wirelessnetwork. Wired communication via the network 90 is performed, forexample, according to a system conforming to a standard such as theEthernet (registered trademark) or the USB. Radio communication via thenetwork 90 is performed according to a system conforming to a standardsuch as the Wi-Fi (registered trademark).

The robot system 3 receives operation from a user with the informationprocessing apparatus 5 and causes the robot 20 to perform predeterminedwork on the basis of the received operation. The predetermined workindicates, for example, as shown in FIG. 28, work for rearranging, in apredetermined position, the work target M arranged on the upper surfaceof the workbench TB. However, the predetermined work may be other work.The workbench TB is, for example, a stand such as a table. Instead ofthe workbench TB, an object on which the work target M can be arranged,for example, a floor surface or a wall surface may be used.

The work target M is an object that can be gripped by the robot 20 andis, for example, a component of an industrial product such as a screw ora bolt. The work target M is not limited to the component and may beother objects. In FIG. 28, the work target M is shown as a rectangularparallelepiped object. The robot system 3 causes the robot 20 to performthe predetermined work on the basis of a position and a posture of thework target M calculated by the image processing apparatus 40C.

The number of the image pickup apparatuses 10 is not limited to one andmay be two or more. In the following explanation, one image pickupapparatus or a group of two or more image pickup apparatuses isgenerally referred to as image pickup apparatus 10. An individual imagepickup apparatus is referred to as camera.

The robot 20 may be communicably connected to the control apparatus 30via a cable. The network 90 may be a wired network or may be a wirelessnetwork. Wired communication via the network 90 is performed, forexample, according to a system conforming to a standard such as theEthernet (registered trademark) or the USB. Radio communication via thenetwork 90 is performed according to a system conforming to a standardsuch as the Wi-Fi (registered trademark). Note that the robot 20 and thecontrol apparatus 30 may be connected by a cable separate from thenetwork 90 or by other networks. The robot 20 is connected to thecontrol apparatus 30 set on the outside of the robot 20 as shown in FIG.28. However, instead of this configuration, the control apparatus 30 maybe incorporated in the robot 20.

The control apparatus 30 acquires an object code from the informationprocessing apparatus 5, executes the acquired object code, and controlsthe robot 20 to perform the predetermined work. More specifically, inthis example, the control apparatus 30 executes the object code andrequests the image processing apparatus 40C to perform, on the basis ofa picked-up image signal acquired from the image pickup apparatus 10,image processing for calculating a position and a posture of the worktarget M.

After the image processing by the image processing apparatus 40C ends,the control apparatus 30 acquires information indicating the positionand the posture of the work target M from the image processing apparatus40C. The control apparatus 30 generates a control signal for controllingthe operation of the robot 20 on the basis of the acquired position andthe acquired posture of the work target M and outputs the generatedcontrol signal to the robot 20. The robot 20 is controlled to performthe predetermined work.

Note that the control apparatus 30 and the robot 20 may be connected bya cable separate from the network 90 or by other networks. The robot 20is connected to the control apparatus 30 set on the outside of the robot20 as shown in FIG. 28. However, instead of this configuration, thecontrol apparatus 30 may be incorporated in the robot 20.

The image processing apparatus 40C acquires a picked-up image signalfrom the image pickup apparatus 10 according to a request from thecontrol apparatus 30. After acquiring the picked-up image signal fromthe image pickup apparatus 10, the image processing apparatus 40Capplies predetermined image processing to the acquired picked-up imagesignal and calculates a position and a posture of the work target M. Theimage processing apparatus 40C outputs information indicating thecalculated position and the calculated posture of the work target M tothe control apparatus 30.

Note that the image processing apparatus 40C may cyclically acquire thepicked-up image signal from the image pickup apparatus 10 instead ofperforming the processing explained above according to the request fromthe control apparatus 30. In this case, the image processing apparatus40C applies, every time a picked-up image is acquired, the imageprocessing to the acquired picked-up image and calculates a position anda posture of the work target M. The image processing apparatus 40Coutputs the calculated position and the calculated posture of the worktarget M to the control apparatus 30 according to a request from thecontrol apparatus 30.

Configuration of the Image Processing Apparatus

The configuration of the image processing apparatus 40C according tothis embodiment is explained.

FIG. 29 is a block diagram showing the configuration of the imageprocessing apparatus 40C according to this embodiment.

The image processing apparatus 40C includes a communication unit 401, acontrol unit 402, an image processing unit 403, a camera control unit404, a notifying unit 405, a first camera communication unit 406, and asecond camera communication unit 407.

The communication unit 401 controls communication of the controlapparatus 30 and the information processing apparatus 5. Thecommunication unit 401 outputs various reception signals received fromthe control apparatus 30 and the information processing apparatus 5 tothe control unit 402. The communication unit 401 transmits various kindsof transmission signals input from the control unit 402 to the controlapparatus 30 and the information processing apparatus 5. Thecommunication unit 401 retains network setting information of the imageprocessing apparatus 40C. The network setting information includes, forexample, an IP address, an IP mask, and a gateway address of the imageprocessing apparatus 40C. Note that an address of the image processingapparatus 40C on the network 90 and a sub-network to which the imageprocessing apparatus 40C belongs only have to be specified from thenetwork setting information. The entire IP address indicates an address.A part of the IP address indicates a sub-network. The IP mask indicatesa range indicating the sub-network in the IP address. The IP mask isalso called sub-network mask.

When receiving a search packet from the information processing apparatus5, the control unit 402 reads the network setting information from thecommunication unit 401 and reads camera information from the cameracontrol unit 404. The control unit 402 generates a search responsepacket including the read network setting information and the readcamera information. The control unit 402 decides an address of a returndestination according to whether a sub-network to which the informationprocessing apparatus 5, which is the transmission source of the searchpacket, belongs and the sub-network to which the image processingapparatus 40C belongs are the same. Specifically, when the sub-networkto which the information processing apparatus 5 belongs and thesub-network to which the image processing apparatus 40C belongs are thesame, the control unit 402 decides an address of the informationprocessing apparatus 5 as the address of the return destination. Whenthe sub-network to which the information processing apparatus 5 belongsand the sub-network to which the image processing apparatus 40C belongsare different, the control unit 402 designates a predetermined broadcastaddress as the address of the return destination. The predeterminedbroadcast address is, for example, a broadcast address specified by aUDP (User Datagram Protocol). The control unit 402 transmits thegenerated search response packet to the address of the returndestination. Therefore, when the sub-network to which the informationprocessing apparatus 5 belongs and the sub-network to which the imageprocessing apparatus 40C belongs are the same, the search responsepacket is transmitted to only the information processing apparatus 5(unicast). When the sub-network to which the information processingapparatus 5 belongs and the sub-network to which the image processingapparatus 40C belongs are different, the search response packet issimultaneously transmitted to all apparatuses connected to the network90 (broadcast). In the following explanation, transmission of the samedata to all apparatuses connected to a network is referred to asbroadcast.

When receiving a change packet from the information processing apparatus5, the control unit 402 determines, according to whether a MAC addressincluded in the received change packet and a MAC address of the imageprocessing apparatus 40C are the same, whether network setting ischanged. MAC addresses are identification information for uniquelyidentifying respective apparatuses. As explained below, the receivedchange packet includes a MAC address of the image processing apparatus40C selected in the information processing apparatus 5. When the MACaddress included in the received change packet and the MAC address ofthe image processing apparatus 40C are the same, the control unit 402changes the network setting information set in the communication unit401 to network setting information included in the received changepacket. When the MAC address included in the received change packet andthe MAC address of the image processing apparatus 40C are different, thecontrol unit 402 neglects the received change packet and does not changethe network setting information set in the communication unit 401.

When the network setting information is changed, the control unit 402generates a change response packet including change processing resultinformation indicating a processing result related to the change and theMAC address of the image processing apparatus 40C. The change processingresult information is information indicating whether the processing issuccessful. The control unit 402 broadcasts the generated changeresponse packet to the network 90. Note that, when succeeding in thechange of the network setting information, the control unit 402 maydesignate only the information processing apparatus 5, which is thetransmission source of the change packet, as a transmission destinationand transmit the change response packet (unicast). In both the cases,the change response packet is transmitted to the information processingapparatus 5.

Note that the control unit 402 controls the operation of the entireimage processing apparatus 40C. For example, when receiving an objectcode of an image processing program from the information processingapparatus 5, the control unit 402 outputs the received object code tothe image processing unit 403. When receiving an image processingrequest signal from the information processing apparatus 5, the controlunit 402 outputs the received image processing request signal to theimage processing unit 403. The image processing request signal is asignal for instructing the control unit 402 to perform, on the basis ofa picked-up image signal, image processing for calculating a positionand a posture of the work target M. The control unit 402 transmits worktarget information input from the image processing unit 403 to thecontrol apparatus 30. The work target information is informationindicating the position and the posture of the work target M calculatedon the basis of the picked-up image signal.

When receiving a monitor instruction signal from the informationprocessing apparatus 5, the control unit 402 outputs the receivedmonitor instruction signal to the image processing unit 403. The monitorinstruction signal is a signal for instructing the control unit 402 todisplay a picked-up image on a display unit 81.

Note that various input signals input from the notifying unit 405 or aninput unit 82 are input to the control unit 402. The input signals aresometimes used for control by the control unit 402. The control unit 402detects an operation state such as an error in the control unit 402 orthe other units, generates notification information indicating thedetected operation state, and outputs the generated notificationinformation to the notifying unit 405.

The image processing unit 403 installs the object code of the imageprocessing program input from the control unit 402. When receiving theimage processing request signal from the control unit 402, the imageprocessing unit 403 starts the installed object code and acquires aprocessing target picked-up image signal from the camera control unit404. As the processing target picked-up image signal, a picked-up imagesignal of a channel instructed by the image processing request signal isselected. Channels mean distinctions of respective cameras connected tothe image processing apparatus 40C or ports for connecting therespective cameras. For example, first cameras 11-1 and 11-2 and secondcameras 12-1 to 12-4 are respectively distinguished by the channels. Theimage processing unit 403 processes the selected picked-up image signalto calculate a position and a posture of the work target M and outputswork target information indicating the calculated position and thecalculated posture to the control unit 402.

When the monitor instruction signal is input from the control unit 402,the image processing unit 403 acquires a processing target picked-upimage signal from the camera control unit 404. As the processing targetpicked-up image signal, a picked-up image signal instructed by themonitor instruction signal is selected. Note that the image processingunit 403 may output not only the picked-up image signal but also apicked-up image signal currently being processed to the display unit 81.

The camera control unit 404 detects presence or absence of connection ofoperating cameras via the first camera communication unit 406 and thesecond camera communication unit 407 and acquires camera informationrespectively from the detected cameras. That is, the camera control unit404 searches for cameras capable of communicating with the imageprocessing apparatus 40C. The camera information is informationincluding identification information and attributes of the cameras. Thecamera information includes, for example, a model name, a serial number,and resolution. The camera information may include channels to which thecameras are connected among channels of the first camera communicationunit 406 and the second camera communication unit 407. The channels areinformation for identifying ports to which the cameras are physicallyconnected. The camera control unit 404 activates communication with thecameras from which the camera information is acquired.

The camera control unit 404 retains the acquired camera information anderases camera information of disconnected cameras. The detection of thepresence or absence of the connection of the cameras by the cameracontrol unit 404 may be performed when an update request signal isreceived from the information processing apparatus 5 besides during thestart. The update request signal is a signal for instructing update ofcamera information and network information retained by the informationprocessing apparatus 5. The camera control unit 404 reads the networksetting information from the communication unit 401 and generates anupdate response packet on the basis of the read network settinginformation and newly acquired or deleted camera information. The cameracontrol unit 404 transmits the generated update response packet to theinformation processing apparatus 5. Consequently, camera information ofthe communicable camera is updated in the information processingapparatus 5.

Picked-up images are sequentially input to the camera control unit 404from the respective connected cameras via the first camera communicationunit 406 and the second camera communication unit 407.

The notifying unit 405 notifies an operation state indicated by thenotification information input from the control unit 402. The notifyingunit 405 acquires an input signal based on operation by the user andoutputs the acquired input information to the control unit 402. Thenotifying unit 405 includes, for example, an LED lamp for notifying theoperation state and a trigger button for acquiring the input signal.

The first camera communication unit 406 and the second cameracommunication unit 407 are respectively communicably connected todifferent types of cameras. In the example shown in FIG. 29, the firstcamera communication unit 406 is connected to the first cameras 11-1 and11-2. The first cameras 11-1 and 11-2 are, for example, USB cameras. Thesecond camera communication unit 407 is connected to the second cameras12-1 to 12-4. The second cameras 12-1 to 12-4 are GigE cameras. In thatcase, the first camera communication unit 406 includes a USB interface.The second camera communication unit 407 includes, for example, a GigEinterface.

The display unit 81 displays an image based on an image signal inputfrom the control unit 402. The display unit 81 is, for example, a liquidcrystal display or an organic EL display.

The input unit 82 acquires various input signals based on operation bythe user and various input signals from an external apparatus. Forexample, the input unit 82 is a mouse, a keyboard, a USB memory, or thelike.

Note that one or both of the display unit 81 and the input unit 82 maybe integrated with the image processing apparatus 40C or may be separatefrom the image processing apparatus 40C.

The input unit 82 may be configured as a touch panel integrated with thedisplay unit 81.

Configuration of the Information Processing Apparatus

The configuration of the information processing apparatus 5 according tothis embodiment is explained.

FIG. 30 is a block diagram showing the configuration of the informationprocessing apparatus 5 according to this embodiment.

The information processing apparatus 5 includes a communication unit501, a control unit 502, a display unit 51, and an input unit 52.

The communication unit 501 controls communication of the controlapparatus 30 and the image processing apparatus 40C. The communicationunit 501 outputs various reception signals received from the controlunit 30 and the image processing apparatus 40C to the control unit 502.The communication unit 501 transmits various transmission signals inputfrom the control unit 502 to the control apparatus 30 and the imageprocessing apparatus 40C. The communication unit 501 retains networksetting information of the information processing apparatus 5.

The control unit 502 includes a search processing unit 503, a settingprocessing unit 504, a program creating unit 505, and animage-processing instructing unit 506.

When a camera search instruction signal is input from the input unit 52,the search processing unit 503 generates a search packet. The searchpacket includes an information request command. The information requestcommand is a command for instructing the search processing unit 503 torequest information set in an apparatus as a transmission destination.The search processing unit 503 broadcasts the generated search packet tothe network 90. When broadcasting the search packet, the searchprocessing unit 503 designates, for example, a predetermined broadcastaddress as a transmission destination address.

The search processing unit 503 receives a search response packet to thetransmitted search packet from the image processing apparatus 40Cconnected to the network. Note that the number of image processingapparatuses 40C, which are transmission sources of the search responsepacket, is not limited to one and may be two or more.

The setting processing unit 504 reads, from the received search responsepacket, network setting information of the image processing apparatus40C at the transmission source and the camera information of the camerasconnected to the image processing apparatus 40C. The setting processingunit 504 associates the read network setting information and the readcamera information and generates search result screen data. The searchresult screen data is an image signal for displaying the camerainformation of each of the cameras and the network setting informationof the image processing apparatus 40C connected to the camera inassociation with each other. The setting processing unit 504 outputs thegenerated search result screen data to the display unit 51. The displayunit 51 displays a search result screen indicated by the search resultscreen data input from the setting processing unit 504. On the searchresult screen, the camera information and the network settinginformation are arranged in association with each other for each of thecameras. Display of the camera information and the network settinginformation related to a specific camera is designated by a cameraselection signal input from the input unit 52. The camera selectionsignal is a signal for indicating any one of the cameras displayed onthe search result screen. Consequently, the user can select a camerathat the user intends to use.

When the camera selection signal is input from the input unit 52, thesetting processing unit 504 reads network setting screen data created inadvance and outputs the read network setting screen data to the displayunit 51. The display unit 51 displays a network setting screen indicatedby the network setting screen data input from the setting processingunit 504. The network setting screen is an image for urging the user toinput network setting information to the image processing apparatus 40Cto which the selected camera is connected. After the input of thenetwork setting information is completed, the setting processing unit504 generates a change packet including the input network settinginformation and a MAC address of the image processing apparatus 40C towhich the selected camera is connected. The setting processing unit 504broadcasts the generated change packet to the network 90. Therefore, thechange packet is transmitted to the image processing apparatus 40C towhich the selected camera is connected.

When receiving the change response packet from the image processingapparatus 40C, the setting processing unit 504 reads the MAC address andthe change processing result information of the image processingapparatus 40C from the received change response packet. When the readchange processing result information indicates success, the settingprocessing unit 504 retains the read MAC address and the selected camerainformation in association with each other.

Screen data for program creation is stored in advance in the programcreating unit 505. The program creating unit 505 outputs the storedscreen data for program creation to the display unit 51 during thestart. The display unit 51 displays a screen for program creation basedon the screen data for program creation input from the program creatingunit 505.

The program creating unit 505 creates a control program or an imageprocessing program on the basis of various input signals input from theinput unit 52. When a control program compile instruction signal isinput from the input unit 52, the program creating unit 505 compiles thecreated control program and converts the created control program into anobject code for a format executable by the control apparatus 30. Theprogram creating unit 505 transmits the converted object code to thecontrol apparatus 30.

When an image processing program compile instruction signal is inputfrom the input unit 52, the program creating unit 505 compiles thecreated image processing program and converts the created imageprocessing program into an object code of a format executable by theimage processing apparatus. The program creating unit 505 transmits theconverted object code to the image processing apparatus 40C.

The image processing instructing unit 506 gives various instructions tothe image processing apparatus 40C on the basis of various input signalsinput from the input unit 52. For example, the image-processinginstructing unit 506 transmits an image processing request signal inputfrom the input unit 52 to the image processing apparatus 40C. Theimage-processing instructing unit 506 transmits a monitor instructionsignal input from the input unit 52 to the image processing apparatus40C.

Note that the image-processing instructing unit 506 may receives apicked-up image signal from the image processing apparatus 40C and causethe display unit 51 of the information processing apparatus 5 to displaya picked-up image based on the received picked-up image signal.

The display unit 51 displays an image based on an image signal inputfrom the control unit 502. The display unit 51 is, for example, a liquidcrystal display or an organic EL display.

The input unit 52 acquires an input signal based on operation by theuser and an input signal from an external apparatus. The input unit 52is, for example, a mouse or a keyboard.

Note that one or both of the display unit 51 and the input unit 52 maybe integrated with the information processing apparatus 5 or may beseparate from the information processing apparatus 5.

System Display Screen

FIG. 31 is a diagram showing an example of a system display screen (asystem display screen sc1). The system display screen sc1 is a screenfor displaying camera information of respective cameras currentlycapable of communicating with the information processing apparatus 5.The system display screen sc1 is a screen that the setting processingunit 504 causes the display unit 51 to display when a system settinginquiry signal is input to the setting processing unit 504 from theinput unit 52.

The system display screen sc1 includes a display field sc11, a “close”button sc12, and an “add” button sc13. In the display field sc11, camerainformation for each of the cameras is displayed. The camera informationincludes a camera type, a model name, and resolution. The model means amodel of the camera. For example, camera information of a camera “1”shown in a second row of the display field sc11 includes the camera type“type 2”, the model name “model 2B”, and the resolution “640×480”. Themodel name indicates a model name of the camera. The resolutionindicates resolution supported by the camera.

The “close” button sc12 is a button for erasing the system displayscreen sc1 by being depressed. “Depressing” means pointing, withoperation on the input unit 52, a position included in a display regionof the button. The pointed position is represented by an input signalgenerated by the input unit 52.

The “add” button sc13 is a button for adding, by being depressed, acamera separate from the camera displayed on the system display screensc1. When the “add” button sc13 is depressed, an addition instructionsignal is input to the setting processing unit 504 from the input unit52. At this point, the setting processing unit 504 causes the displayunit 51 to display an addition method inquiry screen.

Addition Method Inquiry Screen

The addition method inquiry screen is explained.

FIG. 32 is a diagram showing an example of the addition method inquiryscreen (an addition method inquiry screen ar1).

The addition method inquiry screen ar1 is a screen for causing the userto select a method for adding a camera that the user intends to use inthe robot system 3.

The addition method inquiry screen ar1 includes two radio buttons ar11and ar12, an “OK” button ar13, and a “cancel” button ar14.

The two radio buttons ar11 and ar12 are buttons, one of which isdepressed to select a method corresponding to the depressed button. Thebutton depressed most recently is represented by black and the otherbutton is represented by white. In the example shown in FIG. 32, as amethod related to the depressed radio button ar11, “camera search” isselected. The camera search means searching for a camera communicablevia the network 90 connected to the information processing apparatus 5.Note that “manually setting a camera” related to the radio button ar12means the user setting camera information by operating the input unit52.

The “OK” button ar13 is a button for instructing, by being depressed,addition of a camera by the selected method. When the “OK” button ar13is depressed in the example shown in FIG. 32, a camera searchinstruction signal is input to the search processing unit 503 from theinput unit 52. At this point, the search processing unit 503 generates asearch packet and broadcasts the generated search packet to the network90.

The “cancel” button ar14 is a button for instructing, by beingdepressed, cancellation of the addition of a camera. When the “cancel”button ar14 is depressed, the setting processing unit 504 erases theaddition method inquiry screen ar1 that the setting processing unit 504causes the display unit 51 to display.

Search Packet

A search packet is explained.

FIG. 33 is a diagram showing an example of the search packet (a searchpacket sp1). The search packet sp1 is data indicating a command, atransmission destination address, and a port number. A command“RequestInfo” is a command for inquiring an apparatus at a transmissiondestination about setting information. A transmission destinationaddress “255. 255. 255. 255” is a broadcast address specified by UDP.Therefore, all apparatuses belonging to a network connected to theinformation processing apparatus 5, that is, one network aretransmission destinations. The port number is a port number of thetransmission destination apparatus. An application program for realizinga function according to this embodiment is designated by the portnumber. Note that a parameter shown in a third column from the left endof FIG. 33 means additional information stored in the search packet sp1.In the example shown in FIG. 33, the parameter is not included in thesearch packet sp1. The IP address of the information processingapparatus 5 at the transmission source is included in the search packetsp1.

Camera Information

An example of the camera information set in the camera control unit 404of the image processing apparatus 40C is explained.

FIG. 34 is a diagram showing an example of a camera setting displayscreen (a camera setting display screen sc2).

On the camera setting display screen sc2, the camera information set inthe camera control unit 404 of the image processing apparatus 40C isdisplayed.

The camera setting display screen sc2 configures a part of the systemsetting screen and includes a tab sc21, a display field sc22, and a“close” button sc23. The control unit 402 of the image processingapparatus 40C causes the display unit 81 to display the camera settingdisplay screen sc2 according to an input of a camera setting displayrequest signal from the input unit 82.

When the tab sc21 is depressed, the display field sc22 and the “close”button sc23 are displayed. In the display field sc22, a model name, anID (Identifier), and resolution are shown in association with oneanother for each of channels to which the camera is connected. The modelname, the ID, and the resolution are respectively components of thecamera information. IDs are serial numbers for identifying therespective cameras.

The “close” button sc23 is a button for instructing, by being depressed,the control unit 402 to erase the camera setting display screen sc2.When the “close” button sc23 is depressed, the control unit 402 erasesthe camera setting display screen sc2 that the control unit 402 causesthe display unit 81 to display.

Network Information

An example of the network information set in the communication unit 401of the image processing apparatus 40C is explained.

FIG. 35 is a diagram for explaining an example of a system generalsetting display screen (a system general setting display screen sn2).

On the system general setting display screen sn2, the networkinformation set in the communication unit 401 is displayed.

The system general setting display screen sn2 configures a part of thesystem setting screen and includes a tab sn21, a display field sn22, aninput field sn23, a “close” button sn24, an “apply” button sn25, a“save” button sn26, and an input key sn27. The control unit 402 of theimage processing apparatus 40C causes the display unit 81 to display thesystem general setting display screen sn2 according to an input of asystem general setting display request signal from the input unit 82.

When the tab sn21 is depressed, the display field sn22, the “close”button sn24, the “apply” button sn25, the “save” button sn26, and theinput key sn27 are displayed. In the display field sn22, a model name, aserial number, a firmware version, and a MAC address of the imageprocessing apparatus 40C and the input field sn23 are displayed. Thefirmware version is a version of firmware installed in the imageprocessing apparatus 40C. The input field sn23 is a field for inputtingthe network setting information of the image processing apparatus 40C.As the network setting information, an IP address, an IP mask, and agateway address can be input.

The “close” button sn24 is a button for instructing, when beingdepressed, the control unit 402 to erase the system general settingdisplay screen sn2. When the “close” button sn24 is depressed, thecontrol unit 402 erases the system general setting display screen sn2that the control unit 402 causes the display unit 81 to display.

The “apply” button sn25 is a button for instructing, by being depressed,the control unit 402 to apply the input network setting information tothe image processing apparatus 40C. When the “apply” button sn25 isdepressed, the control unit 402 saves the network setting informationinput via the input key sn27 in the communication unit 401.

The “save” button sn26 is a button for instructing, by being depressed,the control unit 402 to save the input network setting informationwithout applying the network setting information to the image processingapparatus 40C. When the “save” button sn26 is depressed, the controlunit 402 saves the network setting information input via the input keysn27.

The input key sn27 is a key for inputting the network settinginformation to the input field sn23. The input key sn27 includes a tenkey, a period key, a backspace key (Bksp), a deletion key, a home key(Home), and an end key (End). The ten key and the period key arerespectively keys for inputting any one of numbers 0 to 9 and a period“.”. The deletion key is a key for deleting an input character. Thebackspace key is a key for deleting a character on the left of an inputcharacter. The home key is a key for moving an input available position(a cursor) to the head of a row. The end key is a key for moving theinput available position to the end of the row.

Note that the camera setting display screen sc2 and the system generalsetting display screen sn2 may be displayed on the display unit 51 bythe setting processing unit 504 of the information processing apparatus5. In that case, the setting processing unit 504 acquires the camerainformation and the network setting information from the imageprocessing apparatus 40C. The setting processing unit 504 may set thenetwork setting information in the image processing apparatus 40C on thebasis of an input signal input from the input unit 52.

Note that the image processing apparatus 40C can change the networksetting information on the basis of the change packet received from theinformation processing apparatus 5 as explained above besides theoperation on the image processing apparatus 40C.

Search Response Packet

The search response packet generated by the control unit 402 isexplained. The control unit 402 generates, according to the reception ofthe search packet from the information processing apparatus 5, thesearch response packet on the basis of the network setting informationread from the communication unit 401 and the camera information readfrom the camera control unit 404.

FIG. 36 is a diagram showing an example of the search response packet (asearch response packet sp2).

The search response packet sp2 includes apparatus information sp20 ofthe image processing apparatus 40C, network setting information s21 ofthe image processing apparatus 40C, and camera information sp22-1 tosp22-6 for each of the cameras. For example, the apparatus informationsp20 includes an IP “XX”, a serial number “00001111”, and a MAC address“00:11:22:AA:BB:CC”. The network setting information sp21 includes an IPaddress “192. 168. 0. 3”, a network mask “255. 255. 255. 0”, and agateway address “192. 168. 0. 1”. The camera information sp22-1 includesa model name “AAA-BBB”, an ID (serial number) “222333”, and resolution“640×480” of the camera.

Determination of a Return Destination

Processing for deciding a return destination of the search responsepacket is explained.

The control unit 402 reads the IP address of the information processingapparatus 5 from the search packet sp1 received from the informationprocessing apparatus 5 and specifies, from the read IP address, thesub-network to which the information processing apparatus 5 belongs. Thecontrol unit 402 reads the IP address of the image processing apparatus40C from the network setting information set in the communication unit401 and specifies, from the read IP address, the sub-network to whichthe image processing apparatus 40C belongs. The sub-network isrepresented by a portion indicated by a network mask from a bit stringforming the IP address.

FIG. 37 is a diagram for explaining the return destination of the searchresponse packet.

As shown in FIG. 37, when the sub-network to which the informationprocessing apparatus 5 belongs and the sub-network to which the imageprocessing apparatus 40C belongs are the same, the control unit 402decides an address (192. 168. 0. 2) of the information processingapparatus 5 as an address of the return destination. Consequently, it ispossible to prevent useless transmission to the other informationprocessing apparatuses 5. When the sub-network to which the informationprocessing apparatus 5 belongs and the sub-network to which the imageprocessing apparatus 40C belongs are different, the control unit 402decides a UDP broadcast address (255. 255. 255. 255) as the address ofthe return destination. The control unit 402 transmits the generatedsearch response packet to the decided address of the return destination.Consequently, it is possible to transmit the search response packet tothe information processing apparatus 5 having the different sub-networkby broadcasting the search response packet to the network 90.

Search Result Screen

The search result screen is explained.

FIG. 38 is a diagram showing an example of the search result screen (asearch result screen sr1). The search result screen sr1 is a screen thatshows a list of camera information of cameras found via the network 90.The search result screen sr1 includes camera information included in thesearch response packet received from the image processing apparatus 40Cby the setting processing unit 504.

The search result screen sr1 includes a display field sr11, a “close”button sr12, an “add” button sr13, and an “update” button sr14. In thedisplay field sr11, an apparatus type, an IP address, a channel, andcamera information are displayed in each row for each of the cameras.The apparatus type means, as a type of a directly found apparatus,distinction between the image processing apparatus 40C and a standalonecamera. The IP address is an IP address of the directly found apparatus.The channel means a channel to which the camera is connected when thedirectly found apparatus is the image processing apparatus 40C. Thedisplayed camera information includes a model name, an ID, andresolution. For example, in a second row of the display field sr11, theapparatus type “image processing apparatus”, the IP address “192. 168.0. 3”, the channel “1-2”, the model name “model 1A”, the ID “61031116”,and the resolution “640×480” are displayed.

Information displayed in the display field sr11 can be instructed foreach row by a camera selection signal input from the input unit 52according to the operation by the user. The setting processing unit 504selects a camera related to the row indicated by the camera selectionsignal.

A row related to camera information already set as a communicable cameraamong the information displayed in the display field sr11 is displayedin a form different from a form of the other rows. The different form isgray display in the example shown in FIG. 38. The display in thedifferent form indicates that the camera related to the row cannot beselected.

Communicable cameras connected to the image processing apparatus 40C arelisted by the search result screen. Therefore, the user can immediatelygrasp presence or absence of a camera that the user intends to use. Itis unnecessary to check in advance the IP address of the imageprocessing apparatus 40C connected to the camera.

The “close” button sr12 is a button for erasing the search result screensr1 by being depressed.

The “add” button sr13 is a button for adding, by being depressed, theselected camera as a camera used in the robot system 3. When the “add”button sr13 is depressed, the setting processing unit 504 causes thedisplay unit 51 to display the network setting screen.

The “update” button sr14 is a button for updating the network settinginformation and the camera information by being depressed. When the“update” button sr14 is depressed, the setting processing unit 504broadcasts the update packet including the update request signal to thenetwork 90. Thereafter, the setting processing unit 504 reads theapparatus information, the network setting information, and the camerainformation from the received update response packet. The settingprocessing unit 504 updates the apparatus information, the networksetting information, and the camera information saved in the settingprocessing unit 504 to the apparatus information, the network settinginformation, and the camera information read from the received updateresponse packet. The setting processing unit 504 erases the apparatustype, the IP address, and the camera information displayed on the searchresult screen sr1 and displays the apparatus type, IP address, and thecamera information included in the updated network setting informationon the search result screen sr1.

Network Setting Screen

The network setting screen is explained.

FIG. 39 is a diagram showing an example of the network setting screen (anetwork setting screen sn3).

The network setting screen sn3 is a screen for inputting the networksetting information of the image processing apparatus 40C to which theselected camera is connected.

The network setting screen sn3 includes an input field sn31, an “OK”button sn32, and a “cancel” button sn33.

The input field sn31 is a field for inputting the network settinginformation of the image processing apparatus 40C. As the networksetting information, an IP address, an IP mask, and a gateway addresscan be input. Note that, when the selected camera is a camera that isnot connected to the image processing apparatus 40C and is connected tothe network 90 alone, network setting information of the camera may beinput to the input field sn31.

The “OK” button sn32 is a button for instructing, by being depressed,the setting processing unit 504 to apply the input network settinginformation. When the “OK” button sn32 is depressed, the settingprocessing unit 504 generates a change packet on the basis of the inputnetwork setting information and the MAC address of the image processingapparatus 40C connected to the selected camera. The setting processingunit 504 broadcasts the generated change packet to the network 90.

The “cancel” button sn33 is a button for instructing, by beingdepressed, the setting processing unit 504 to erase of the networksetting screen sn3. When the “cancel” button sn33 is depressed, thesetting processing unit 504 erases the network setting screen sn3 thatthe setting processing unit 504 causes the display unit 51 to display.At this point, the setting processing unit 504 erases the informationinput to the input field sn31.

With the network setting screen, it is possible to change the networksetting information of the image processing apparatus 40C in selectingor adding a camera. Therefore, it is possible to reduce time requiredfor a setting change.

Change Packet

The change packet is explained.

FIG. 40 is a diagram showing an example of the change packet (a changepacket cp1).

The change packet cp1 is data indicating a command, a transmissiondestination address, and a port number. The command “SetIPAddress” is acommand for setting network setting information in an apparatus at atransmission destination. The transmission destination address “255.255. 255. 255” is a broadcast address specified by UDP. Parametersinclude the MAC address of the image processing apparatus 40C related tothe selected camera and input network setting information, i.e., an IPaddress, a network mask, and a gateway address. The port number is aport number of the transmission destination apparatus. Note that thechange packet cp1 includes the IP address of the information processingapparatus 5 at the transmission source.

Necessity Determination for a Network Setting Information Change

Necessity determination for a network setting information change by thecontrol unit 402 of the image processing apparatus 40C is explained.

FIG. 41 is a diagram for explaining the necessity determination for thenetwork setting information change.

The control unit 402 reads the MAC address from the change packetreceived from the information processing apparatus 5 and compares theread MAC address and the MAC address of the image processing apparatus40C. When the read MAC address and the MAC address of the imageprocessing apparatus 40C are the same, the control unit 402 determinesthat the network setting information is changed. When determining thatthe network setting information is changed, the control unit 402 readsthe network setting information from the received change packet. Thecontrol unit 402 changes the network setting information set in thecommunication unit 401 to the read network setting information, that is,a new IP address, a new network mask, and a new gateway address. On theother hand, when the read MAC address and the MAC address of the imageprocessing apparatus 40C are different, the control unit 402 neglectsthe received change packet.

Change Response Packet

The change response packet generated by the control unit 402 afterperforming the processing related to the change of the network settinginformation is explained.

FIG. 42 is a diagram showing an example of the change response packet (achange response packet cp2). The change response packet cp2 includes theMAC address of the image processing apparatus 40C and change processingresult information (a change processing result of an IP address). Thechange processing result information is represented by indicatingsuccess of processing or an error number indicating a failure cause. Thefailure cause is, for example, designation of a numerical value outsidea predetermined range as an IP address in the network settinginformation intended to be changed.

Network Processing

Network processing according to this embodiment is explained.

FIG. 43 is a sequence chart showing the network processing according tothis embodiment.

(Step S201) A camera search instruction signal is input to the searchprocessing unit 503 of the information processing apparatus 5 from theinput unit 52. Thereafter, the search processing unit 503 proceeds tostep S202.

(Step S202) The search processing unit 503 generates a search packet.Thereafter, the search processing unit 503 proceeds to step S203.

(Step S203) The search processing unit 503 broadcasts the generatedsearch packet to the network 90. After receiving the search packet fromthe information processing apparatus 5, the control unit 402 of theimage processing apparatus 40C proceeds to step S204.

(Step S204) The control unit 402 reads network setting information fromthe communication unit 401 and reads camera information from the cameracontrol unit 404. The control unit 402 generates a search responsepacket including the read network setting information and the readcamera information. Thereafter, the control unit 402 proceeds to stepS205.

(Step S205) The control unit 402 decides, according to whether thesub-network to which the information processing apparatus 5 belongs andthe sub-network to which the image processing apparatus 40C belongs arethe same, whether an address of the information processing apparatus 5or a UDP broadcast address is set as an address of a return destination.Thereafter, the control unit 402 proceeds to step S206.

(Step S206) The control unit 402 transmits the generated search responsepacket to the return destination designated by the decided address.After receiving the search response packet from the image processingapparatus 40C, the setting processing unit 504 of the informationprocessing apparatus 5 proceeds to step S207.

(Step S207) The setting processing unit 504 generates search resultscreen data on the basis of the network setting information and thecamera information read from the received search response packet. Thesetting processing unit 504 outputs the generated search result screendata to the display unit 51 to thereby cause the display unit 51 todisplay a search result screen. Thereafter, the setting processing unit504 proceeds to step S208.

(Step S208) When a camera selection signal is input from the input unit52, the setting processing unit 504 outputs network setting screen datato the display unit 51 to thereby cause the display unit 51 to display anetwork setting screen. The setting processing unit 504 acquires networksetting information from the input unit 52. Thereafter, the settingprocessing unit 504 proceeds to step S209.

(Step S209) The setting processing unit 504 generates a change packetincluding the acquired network setting information and the MAC addressof the image processing apparatus 40C to which the selected camera isconnected. Thereafter, the setting processing unit 504 proceeds to stepS210.

(Step S210) The setting processing unit 504 broadcasts the generatedchange packet to the network 90. After receiving the search packet fromthe information processing apparatus 5, the control unit 402 of theimage processing apparatus 40C proceeds to step S211.

(Step S211) The control unit 402 determines, according to whether theMAC address included in the change packet received from the informationprocessing apparatus 5 and the MAC address of the image processingapparatus 40C are the same, whether network setting is changed. When theMAC address included in the change packet and the MAC address of theimage processing apparatus 40C are the same (YES in step S211), thecontrol unit 402 proceeds to step S212. When the MAC address included inthe change packet and the MAC address of the image processing apparatus40C are different (NO in step S211), the control unit 402 ends theprocessing shown in FIG. 43.

(Step S212) The control unit 402 changes the network setting informationset in the communication unit 401 to the network setting informationincluded in the received change packet. Thereafter, the control unit 402proceeds to step S213.

(Step S213) The control unit 402 generates a change response packetincluding the change processing result information and the MAC addressof the image processing apparatus 40C. Thereafter, the control unit 402proceeds to step S214.

(Step S214) The control unit 402 transmits the generated change responsepacket to the information processing apparatus 5. The setting processingunit 504 of the information processing apparatus 5 reads the MAC addressand the change processing result information from the change responsepacket received from the image processing apparatus 40C. When the readchange processing result information indicates success, the settingprocessing unit 504 retains the read MAC address and the selected camerainformation in association with each other. Thereafter, the control unit402 ends the processing shown in FIG. 43.

In step S208, it is also likely that, as the network setting informationof the image processing apparatus 40C, any network setting informationis acquired via the network setting screen described above according tooperation by the user. However, when an unused IP address belonging to asub-network same as the sub-network to which the information processingapparatus 5 belongs is designated as the network setting information ofthe image processing apparatus 40C, the information processing apparatus5 is capable of transmitting and receiving various data to and from theselected camera via the image processing apparatus 40C. For example, theimage processing apparatus 40C can transmit a picked-up image signalacquired from the selected camera to the information processingapparatus 5. The information processing apparatus 5 can receive thepicked-up image signal from the image processing apparatus 40C.

In step S208, the setting processing unit 504 may search for an IPaddress to which an apparatus is not connected among IP addressesbelonging to the sub-network same as the sub-network to which theinformation processing apparatus 5 belongs and automatically generatenetwork setting information that designates a found IP address. Thesetting processing unit 504 broadcasts an address inquiry packetincluding a network setting information inquiry command and notdesignating a port number to the network 90 and receives an addressinquiry response packet corresponding to the address inquiry packet. Thesetting processing unit 504 reads, as an IP address in use, the IPaddress included in the network setting information from the receivedaddress inquiry response packet. The setting processing unit 504specifies a range of an IP address belonging to the sub-network to whichthe information processing apparatus 5 belongs from the IP address ofthe information processing apparatus 5 indicated by the network settinginformation of the information processing apparatus 5 and a range of abit designated by a network mask. The setting processing unit 504selects any one of unused IP addresses excluding the IP address in usefrom the specified range of the IP address. The setting processing unit504 generates network setting information including the selected IPaddress and the network mask and the gateway address of the informationprocessing apparatus 5. Consequently, the user can check the unused IPaddresses and omit operation for setting. Therefore, it is possible tofurther facilitate operation related to the setting.

As explained above, the image processing system 2 according to thisembodiment includes the image processing apparatus 40C that processes apicked-up image and the information processing apparatus 5 that displaysa screen on which setting of the image processing apparatus 40C isperformed. The image processing apparatus 40C searches for the imagepickup apparatus 10 communicable with the image processing apparatus.The information processing apparatus 5 displays information concerningthe communicable image pickup apparatus 10 found by the image processingapparatus 40C.

With this configuration, information concerning the communicable imagepickup apparatus 10 found by the image processing apparatus 40C isdisplayed. Therefore, the user can select, from the displayed imagepickup apparatuses 10, the image pickup apparatus 10 that the userdesires to use. Therefore, it is unnecessary to check, in setting of theimage pickup apparatus 10, information concerning the image pickupapparatus 10 that the user desires to use.

In the image processing system 2 according to this embodiment, theinformation processing apparatus 5 broadcasts a search packet includinga command for inquiring about information set in an apparatus at atransmission destination to the network 90 connected to the informationprocessing apparatus 5. When receiving the search packet from theinformation processing apparatus 5, the image processing apparatus 40Cbroadcasts a search response packet including the information concerningthe found communicable image pickup apparatus 10 to the network 90.

With this configuration, even when the image processing apparatus 40C,to which the image pickup apparatus 10 is connected, belongs to asub-network different from the sub-network to which the informationprocessing apparatus 5 belongs, the information processing apparatus 5can acquire information concerning the image pickup apparatus 10connected to the image processing apparatus 40C. Therefore, the user canobtain a clue for using, without omission, the image pickup apparatus 10found by the image processing apparatus 40C connected to the network 90.

In the image processing system 2 according to this embodiment, the imageprocessing apparatus 40C includes the IP address of the image processingapparatus 40C in the search response packet. The information processingapparatus 5 displays the IP address in association with the informationconcerning the image pickup apparatus 10.

With this configuration, the IP address of the image processingapparatus 40C related to the image pickup apparatus 10 that the userdesires to use is displayed. Therefore, the user can check the IPaddress in the setting for using the image pickup apparatus 10.

In the image processing system 2 according to this embodiment, theinformation processing apparatus 5 acquires a new IP address andbroadcasts a change packet including the acquired IP address to thenetwork 90 connected to the information processing apparatus 5. Theimage processing apparatus 40C changes the IP address set in the imageprocessing apparatus 40C to the IP address included in the change packetreceived from the information processing apparatus 5.

With this configuration, even when the image processing apparatus 40C,to which the image pickup apparatus 10 is connected, belongs to asub-network different from the sub-network to which the informationprocessing apparatus 5 belongs, it is possible to change the IP addressset in the image processing apparatus 40C to the IP address acquired bythe information processing apparatus 5. For example, by causing theinformation processing apparatus 5 to acquire an unused IP addressbelonging to a sub-network same as the sub-network to which theinformation processing apparatus 5 belongs, it is possible to cause theimage processing apparatus 40C to belong to a sub-network same as thesub-network to which the information processing apparatus 5 belongs.

In the image processing system 2 according to this embodiment, theinformation processing apparatus 5 decides, as the IP address of theimage processing apparatus 40C, an unused IP address belonging to asub-network same as the sub-network to which the information processingapparatus 5 belongs.

With this configuration, the user can cause, without checking an IPaddress in advance and inputting the IP address, the image processingapparatus 40C to belong to a sub-network same as the sub-network towhich the information processing apparatus 5 belongs. Consequently, itis possible to perform communication of the information processingapparatus 5 and the image pickup apparatus 10 connected to the imageprocessing apparatus 40C.

In the image processing system 2 according to this embodiment, when theimage processing apparatus 40C belongs to a sub-network same as thesub-network to which the information processing apparatus 5 belongs, theimage processing apparatus 40C includes, in the search response packet,the IP address of the information processing apparatus 5 as the IPaddress of the transmission destination.

With this configuration, by broadcasting the search response packet, itis possible to avoid useless communication in which the search responsepacket is transmitted to apparatuses other than a display apparatus aswell.

The embodiments of the invention are explained above in detail withreference to the drawings. However, specific components are not limitedto the embodiments and may be, for example, changed, substituted, anddeleted without departing from the spirit of the invention.

For example, in the example explained in the embodiments, the robot 20is the single-arm robot including one arm. However, not only this, butthe robot 20 may be a double-arm robot including two arms or may be ahorizontal articulated robot (so-called SCARA robot).

The image processing apparatus 40C may be separate from the controlapparatus 30C as explained above or may be configured integrally withthe control apparatus 30C.

The control apparatus 30 may be separate from the robot 20 as explainedabove or may be configured integrally with the robot 20.

Seventh Embodiment

An embodiment of the invention is explained below with reference to thedrawings. Note that components same as the components in the firstembodiment are denoted by the same reference numerals and signs andexplanation of the components is omitted or simplified.

In the following explanation, an abnormal state notifying function foran image processing apparatus by the control apparatus 30 in the robotsystem 1 configured as shown in FIG. 1 is explained. The abnormal statenotifying function is a function of detecting an event indicating astate in which a part or all of one or more functional units by hardwareor a part of or the entire control processing by software included in animage processing apparatus 40E is highly likely to be out of order or astate in which a part or all of one or more functional units by hardwareor a part of or the entire control processing by software is highlylikely to fail in future, for example, the temperature of a CPU includedin the image processing apparatus 40E excessively rises, and performingnotification based on the detected event.

In the following explanation, for convenience of explanation, the eventindicating a state in which a part or all of one or more functionalunits by hardware or a part of or the entire control processing bysoftware included in the image processing apparatus 40E is highly likelyto be out of order or a state in which a part or all of one or morefunctional units by hardware or a part of or the entire controlprocessing by software is highly likely to fail in future is referred toas an event indicating abnormality of the image processing apparatus 40Eand explained. The state in which a part or all of one or morefunctional units by hardware or a part of or the entire controlprocessing by software is highly likely to fail in future indicates, inthis example, a state in which a probability of failure within apredetermined time exceeds a predetermined value when the imageprocessing apparatus 40E continues to be used with a state of use of theimage processing apparatus 40E is maintained. However, the state mayindicate other states.

The hardware configuration of the control apparatus 30 is explained withreference to FIG. 44.

FIG. 44 is a diagram showing an example of the hardware configuration ofthe control apparatus 30 according to this embodiment. The controlapparatus 30 includes, for example, a CPU 31, a storing unit 32, aninput receiving unit 33, a communication unit 34, and an output unit 35.The control apparatus 30 performs communication with the informationprocessing apparatus 5, the image processing apparatus 40E, otherapparatuses, and the like via the communication unit 34. Thesecomponents are communicably connected to one another via the bus Bus.The CPU 31 executes various computer programs stored in the storing unit32.

The storing unit 32 includes, for example, a HDD, an SSD, an EEPROM, aROM, or a RAM and stores various kinds of information, images, computerprograms, and the like to be processed by the control apparatus 30.

Note that the storing unit 32 may be an external storage deviceconnected by, for example, a digital input/output port such as the USBinstead of a storage device incorporated in the control apparatus 30.

The input receiving unit 33 may be, for example, a keyboard, a mouse, atouch pad, or other input devices. The input receiving unit 43 may beconfigured integrally with a display as a touch panel.

The communication unit 34 includes, for example, digital input/outputports such as a plurality of Ethernet (registered trademark) ports or aplurality of USBs.

The output unit 35 may include, for example, a liquid crystal displaypanel or an organic EL display panel or may include a speaker thatoutputs sound.

The hardware configuration of the image processing apparatus 40E isexplained with reference to FIG. 45.

FIG. 45 is a diagram showing an example of the hardware configuration ofthe image processing apparatus 40E. The image processing apparatus 40Eincludes, for example, the CPU 71, the storing unit 72, the inputreceiving unit 43, the communication unit 74, the output unit 75, andthe detecting unit 76. The image processing apparatus 40E performscommunication with the control apparatus 30, other image processingapparatuses 40E, other apparatuses, and the like via the communicationunit 74. These components are communicably connected to one another viathe bus Bus. The CPU 71 executes various kinds of computer programsstored in the storing unit 72.

The output unit 75 includes a plurality of LEDs and notifies variouskinds of information with lighting states (e.g., extinguishing,lighting, and blinking) of the LEDs. In the explanation of this example,it is assumed that the output unit 75 includes one green LED and one redLED. However, colors of the LEDs may be respectively other colors or maybe the same color. Note that, instead of including the LEDs, the outputunit 75 may include, for example, a liquid crystal display panel or anorganic EL display panel or may include a speaker that outputs sound.

The detecting unit 76 is a plurality of sensors for detecting physicalquantities serving as indexes indicating that an event indicatingabnormality of a respective plurality of pieces of hardware included inthe image processing apparatus 40E has occurred. The event indicatingthe abnormality of hardware indicates an event in which the imageprocessing apparatus 40E is replaced with hardware in the definition ofthe event indicating the abnormality of the image processing apparatus40E.

In this example, the physical quantities serving as the indexesindicating that the event indicating the abnormality of the hardwareincluded in the image processing apparatus 40E are the number ofrevolutions of the cooling fan for the CPU 71, the number of revolutionsof the system fan that cools the inside of a housing of the imageprocessing apparatus 40E, the temperature of the CPU 71, and a voltagevalue of the battery for BIOS backup incorporated in the imageprocessing apparatus 40E. However, instead, the physical quantities maybe combinations of these physical quantities, may be combinations ofthese physical quantities and other physical quantities, or may be oneor more other physical quantities. Note that the physical quantitiesserving as the indexes indicating that the event indicating theabnormality of a plurality of the hardware included in the imageprocessing apparatus 40E has occurred are an example of one or morephysical quantities indicating a state of the hardware of the imageprocessing apparatus 40E.

The functional configuration of the control apparatus 30 is explainedwith reference to FIG. 46.

FIG. 46 is a diagram showing an example of the functional configurationof the control apparatus 30. The control apparatus 30 includes thestoring unit 32, the communication unit 34, the output unit 35, and acontrol unit 37.

The control unit 37 includes a detection-information acquiring unit 371,an abnormal-event detecting unit 372, a state determining unit 373, anoutput control unit 374, a communication control unit 375, and a robotcontrol unit 376. A part or all of the functional units included in thecontrol unit 37 are realized by, for example, the CPU 31 executing acomputer program stored in the storing unit 32. A part of the functionalunits may be hardware functional units such as an LSI and an ASIC.

The detection-information acquiring unit 371 cyclically (e.g., everytime one minute elapses) acquires detection information from the imageprocessing apparatus 40E via the communication unit 34. In this example,the detection information includes physical quantities respectivelydetected by the first to fourth detecting units 461 to 464 included inthe detecting unit 76 of the image processing apparatus 40E, informationindicating free capacities of respective storage regions of the memory421 and the storage 422 included in the storing unit 72 of the imageprocessing apparatus 40E, and information indicating an error coderelated to the processing of the image processing apparatus 40E. Notethat the detection-information acquiring unit 371 may be configured toalways continue to acquire the detection information from the imageprocessing apparatus 40E or may be configured to acquire the detectioninformation at predetermined time instead of being configured tocyclically acquire the detection information. Note that thedetection-information acquiring unit 371 is an example of the receivingunit in the aspect of the invention. The detection information is anexample of the state information in the aspect of the invention.

The abnormal-event detecting unit 372 detects an event indicatingabnormality of the image processing apparatus 40E acquired from theimage processing apparatus 40E by the detection-information acquiringunit 371. More specifically, the abnormal-event detecting unit 372detects, on the basis of the detection information acquired by thedetection-information acquiring unit 371, an event indicatingabnormality of the hardware included in the image processing apparatus40E. The abnormal-event detecting unit 372 detects, on the basis of theerror code related to the processing of the image processing apparatus40E, an event indicating abnormality related to the control of the imageprocessing apparatus 40E (the control processing by the softwareexplained above). Note that the abnormal-event detecting unit 372 is anexample of the event detecting unit in the aspect of the invention.

When the event indicating the abnormality of the image processingapparatus 40E is detected by the abnormal-event detecting unit 372, thestate determining unit 373 determines a state of the image processingapparatus 40E explained below on the basis of the detected eventindicating the abnormality of the image processing apparatus 40E. Notethat the state determining unit 373 is an example of the determiningunit in the aspect of the invention.

The output control unit 374 causes the output unit 35 to displayinformation indicating a determination result of the state of the imageprocessing apparatus 40E by the state determining unit 373. Note that,for example, when the output unit 35 is a speaker, the output controlunit 374 causes the output unit 35 to output sound representing theinformation indicating the determination result of the state of theimage processing apparatus 40E by the state determining unit 373.

When the event indicating the abnormality of the image processingapparatus 40E is detected by the abnormal-event detecting unit 372 orwhen a request from the information processing apparatus 5 is acquired,the communication control unit 375 generates a transmission signalincluding information indicating the state of the image processingapparatus 40E determined by state determining unit 373 and outputs thegenerated transmission signal to the information processing apparatus 5via the communication unit 34. In the following explanation, forconvenience of explanation, the communication control unit 375generating transmission signal including certain information P andoutputting the generated transmission signal to an external apparatus(e.g., the information processing apparatus 5) via the communicationunit 34 is simply referred to as the communication control unit 375causing the communication unit 34 to output the information P to theexternal apparatus and explained.

The information indicating the state of the image processing apparatus40E is, in this example, a numerical value for identifying the state ofthe image processing apparatus 40E. However, the information may beother information for identifying the state of the image processingapparatus 40E such as a character, a sign, or the like. In the followingexplanation, for convenience of explanation, the numerical value isreferred to as state code and explained. The state code is an example ofthe information for identifying the state of the image processingapparatus in the aspect of the invention. The communication control unit375 causes the communication unit to output, to the image processingapparatus 40E, a request for changing an output state of the output unit75 included in the image processing apparatus 40E to an output statecorresponding to the determination result of the determination by thestate determining unit 373. Note that the communication control unit 375is an example of each of the generating unit and the communicationcontrol unit in the aspect of the invention.

The robot control unit 376 acquires an object code from the informationprocessing apparatus 5 via the communication unit 34 and causes therobot 20 to perform the predetermined work on the basis of the acquiredobject code. When causing the robot 20 to perform the predeterminedwork, the robot control unit 376 requests, on the basis of the objectcode, the image processing apparatus 40E to acquire a picked-up image ofa range including the work target M picked up by the image pickupapparatus 10 and perform, on the basis of the acquired picked-up image,image processing for calculating a position and a posture of the worktarget M.

The robot control unit 376 acquires information indicating the positionand the posture of the work target M from the image processing apparatus40E after the image processing by the image processing apparatus 40Eends. The robot control unit 376 generates a control signal based on theacquired position and the acquired posture of the work target M andoutputs the generated control signal to the robot 20 to cause the robot20 to perform the predetermined work.

The functional configuration of the image processing apparatus 40E isexplained with reference to FIG. 47.

FIG. 47 is a diagram showing an example of the functional configurationof the image processing apparatus 40E. The image processing apparatus40E includes the storing unit 72, the communication unit 74, the outputunit 75, the detecting unit 76, and the control unit 77. Note that, inthis example, in the following explanation, it is assumed that the imagepickup apparatus 10 is connected to the first image-pickup communicationunit 442 and an image pickup apparatus is not connected to the secondimage-pickup communication unit 443.

The control unit 77 controls the entire image processing apparatus 40E.The control unit 77 includes the detection-information acquiring unit471, then output control unit 474, the communication control unit 475,the image-pickup control unit 476, the image acquiring unit 477, and theimage processing unit 478. A part or all of the functional unitsincluded in the control unit 77 are realized by, for example, the CPU 71executing the computer program stored in the storing unit 72. A part ofthe functional units may be hardware functional units such as an LSI andan ASIC.

The detection-information acquiring unit 471 cyclically (e.g., everytime one minute elapses) acquires physical quantities detected by therespective first to fourth detecting units 461 to 464 included in thedetecting unit 76. The detection-information acquiring unit 471cyclically (e.g., every time one minute elapses) acquires informationindicating free capacities of storage regions respectively from thememory 421 and the storage 422 included in the storing unit 72. In thefollowing explanation, for convenience of explanation, a plurality ofphysical quantities acquired from the detecting unit 76 and informationindicating two free capacities acquired from the storing unit 72 arecollectively referred to as detection information and explained. Notethat the detection-information acquiring unit 471 may be configured toalways continue to acquire the detection information or may beconfigured to acquire the detection information at predetermined timeinstead of being configured to cyclically acquire the detectioninformation.

The output control unit 474 changes an output state (in this example, alighting state) of the output unit according to a request acquired fromthe control apparatus 30 via the external communication unit 441.

The communication control unit 475 causes the external communicationunit 441 to output information indicating the position and the postureof the work target M calculated by the image processing unit 478 to thecontrol apparatus 30.

The image-pickup control unit 476 causes, via the first image-pickupcommunication unit 442, the image pickup apparatus 10 to pick up animage of a range including the work target M. When some image pickupapparatus Z is connected to the second image-pickup communication unit443, the image-pickup control unit 476 causes, via the secondimage-pickup communication unit 443, the image pickup apparatus Z topick up an image of a range in which the image pickup apparatus Z canpick up an image.

The image acquiring unit 477 acquires a picked-up image from the imagepickup apparatus 10 via the first image-pickup communication unit 442.When the image pickup apparatus Z is connected to the secondimage-pickup communication unit 443, the image acquiring unit 477acquires a picked-up image from the image pickup apparatus Z via thesecond image-pickup communication unit 443.

The image processing unit 478 performs, on the basis of the picked-upimage acquired by the image acquiring unit 477, image processing forcalculating a position and a posture of the work target M.

Processing performed by the control unit 37 of the control apparatus 30is explained with reference to FIG. 48.

FIG. 48 is a flowchart for explaining an example of a flow of theprocessing performed by the control unit 37 of the control apparatus 30.In this embodiment, the control unit 37 intends to cyclically (e.g.,every time one minute elapses) perform the flow of the processing shownin FIG. 48 while a power supply for the image processing apparatus 40Econnected to the control apparatus 30 is turned on. However, forexample, the control unit 37 may be configured to perform the flow ofthe processing at predetermined time or may be configured to alwaysperform the flow of the processing. Note that the control apparatus 30may be configured to perform the flow of the processing shown in FIG. 48according to a request from the information processing apparatus 5.

First, the detection-information acquiring unit 371 outputs a requestfor detection information acquisition to the image processing apparatus40E via the communication unit 34. The detection-information acquiringunit 371 acquires, via the communication unit 34, detection informationfrom the image processing apparatus 40E as a response to the request(step S310). Subsequently, the abnormal-event detecting unit 372detects, on the basis of the detection information acquired by thedetection-information acquiring unit 471 in step S310, an eventindicating abnormality of the image processing apparatus 40E.

In this example, the event indicating the abnormality of the imageprocessing apparatus 40E is thirteen events A) to M) described below.Note that the event indicating the abnormality of the image processingapparatus 40E may be a part of the thirteen events A) to M), may includeother events in addition to the events A) to M), or may be a part ofevents including the other events and the events A) to M). In the eventsA) to M), together with the events indicating abnormality of the imageprocessing apparatus 40E, conditions under which the respective eventsare detected are explained.

A) The temperature of the CPU 71 included in the detection informationis within a predetermined range X1 (e.g., 90° or more and less than 100°C.), B) the temperature of the CPU 71 included in the detectioninformation is a predetermined threshold Y1 (e.g., 100° C.) or more, C)the number of revolutions of the cooling fan for the CPU 71 included inthe detection information is within a predetermined range X2 (e.g., not0 RPM (Revolution Per Minute) and less than 1000 RPM), D) the number ofrevolutions of the cooling fan for the CPU 71 included in the detectioninformation is a predetermined threshold Y2 (e.g., 0 RPM) or less, E)the number of revolutions of the system fan that cools the inside of thehousing of the image processing apparatus 40E included in the detectioninformation is within a predetermined range X3 (e.g., not 0 RPM and lessthan 1000 RPM), F) the number of revolutions of the system fan thatcools the inside of the housing of the image processing apparatus 40Eincluded in the detection information is a predetermined threshold Y3(e.g., 0 RPM) or less, G) the voltage value of the battery for BIOSbackup incorporated in the image processing apparatus 40E included inthe detection information is within a predetermined range X4 (e.g., 2 Vor more and less than 2.5 V), H) the voltage value of the battery forBIOS backup incorporated in the image processing apparatus 40E includedin the detection information is less than a predetermined threshold Y4(e.g., 2 V), I) a code indicating a command error is included in anerror code included in the detection information, J) a free space of thememory 421 included in the detection information is less than apredetermined threshold Y5 (e.g., less than 10 MByte), K) a free spaceof the storage 422 included in the detection information is less than apredetermined threshold Y6 (e.g., 10 MByte), L) a code indicating adetection information acquisition error by the detection-informationacquiring unit 471 is included in the error code included in thedetection information, and M) a code indicating a control error of theoutput unit 75 by the output control unit 474 is included in the errorcode included in the detection information.

Note that, in the following explanation, for convenience of explanation,it is assumed that, in step S320, the event A) among the events A) to M)is detected by the abnormal-event detecting unit 372.

Subsequently, the state determining unit 373 determines a state of theimage processing apparatus 40E on the basis of the event indicating theabnormality of the image processing apparatus 40E detected by theabnormal-event detecting unit 372 in step S330 (in this example, theevent A)) (step S330). Processing for determining the state of the imageprocessing apparatus 40E by the state determining unit 373 is explained.The state determining unit 373 determines, on the basis of the eventindicating the abnormality of the image processing apparatus 40Edetected by the abnormal-event detecting unit 372 in step S330, thestate of the image processing apparatus 40E from a correspondencerelation shown in FIG. 49.

FIG. 49 is a diagram showing an example of a correspondence relationamong the event indicating the abnormality of the image processingapparatus 40E, a condition under which the event indicating theabnormality of the image processing apparatus 40E is detected, the stateof the image processing apparatus 40E, and a state code for identifyingthe state of the image processing apparatus 40E.

For example, when the abnormal-event detecting unit 372 does not detectthe event indicating the abnormality of the image processing apparatus40E, on the basis of the correspondence relation shown in FIG. 49, thestate determining unit 373 determines that the state of the imageprocessing apparatus 40E is a normal state (a state code is 0). Thenormal state is an example of the normal state in the aspect of theinvention. When the abnormal-event detecting unit 372 detects CPUtemperature abnormality (when a condition for detection is 90° C. orhigher and less than 100° C.) as the event indicating the abnormality ofthe image processing apparatus 40E, the state determining unit 373determines that the state of the image processing apparatus 40E is awarning occurrence state. The warning occurrence state is a state inwhich a part or all of one or more functional units by hardware or apart of or the entire control processing by software included in theimage processing apparatus 40E is highly likely to fail in future.

When the abnormal-event detecting unit 372 detects CPU temperatureabnormality (when a condition for detection is 100° C. or more) as theevent indicating the abnormality of the image processing apparatus 40E,the state determining unit 373 determines that the state of the imageprocessing apparatus 40E is an error occurrence state. The erroroccurrence state is a state in which a part or all of one or morefunctional units by hardware or a part of or the entire controlprocessing by software included in an image processing apparatus 40E ishighly likely to be out of order.

Note that the correspondence relation shown in FIG. 49 is only anexample. States and state codes of the other image processingapparatuses 40E may be associated with the event indicating theabnormality of the image processing apparatus 40E. Instead of any one ofthe three states, i.e., the normal state, the warning occurrence state,and the error occurrence state, the state of the image processingapparatus 40E may be any one of a part of the three states, may be anyone of one or more other states different from the three states, or maybe any one of four or more states including the three states and anotherstate.

In this example, the event indicating the abnormality of the imageprocessing apparatus 40E detected by the abnormal-event detecting unit372 in step S330 is the event A) explained above (i.e., the eventindicating the abnormality of the image processing apparatus 40Eassociated with a state code 1 shown in FIG. 49). Therefore, in stepS330, the state determining unit 373 determines that the state of theimage processing apparatus 40E is the warning occurrence state.

Subsequently, the communication control unit 375 causes thecommunication unit 34 to output, to the image processing apparatus 40E,a request for changing the lighting state of the output unit 75 includedin the image processing apparatus 40E to a lighting state correspondingto the state of the image processing apparatus 40E detected by the statedetermining unit 373 in step S330 (the determination result of thedetermination by the state determining unit 373) (step S330). Whenacquiring this request, the output control unit 474 included in theimage processing apparatus 40E changes the lighting state of the outputunit 75 according to the acquired request. Processing for changing thelighting state of the output unit 75 by the output control unit 474 isexplained. The output control unit 474 causes, according to the state ofthe image processing apparatus 40E detected by the state determiningunit 373 in step S330, the output unit 75 to change the lighting stateon the basis of the correspondence relation shown in FIG. 50.

FIG. 50 is a table showing an example of rules for the change of thelighting state of the output unit 75 by the output control unit 474.

When the state of the image processing apparatus 40E detected by thestate determining unit 373 is the warning occurrence state, the outputcontrol unit 474 causes the output unit 75 to change the lighting stateof the output unit 75 to the blinking. On the other hand, when the stateof the image processing apparatus 40E detected by the state determiningunit 373 is the error occurrence state, the output control unit 474causes the output unit 75 to change the lighting state of the outputunit 75 to the lighting. In this example, the state of the imageprocessing apparatus 40E detected by the state determining unit 373 instep S330 is the warning occurrence state. Therefore, the output controlunit 474 causes the output unit 75 to change the lighting state of theoutput unit 75 to the blinking.

Note that, in this example, after causing the output unit 75 to change alighting state of the red LED included in the output unit 75 to theblinking or lighting, when the state determining unit 373 determinesthat the state of the image processing apparatus 40E is the normal state(i.e., the state of the image processing apparatus 40E is restored tothe normal state from the warning occurrence state or the erroroccurrence state), the output control unit 474 is configured to causethe output unit 75 to change the lighting state of the red LED includedin the output unit 75 to extinguishing. However, the output control unit474 may be configured to cause the output unit 75 to change the lightingstate of the red LED to a lighting state other than the blinking, thelighting, and the extinguishing.

When a plurality of events indicating abnormality of the imageprocessing apparatus 40E are detected and the state of the imageprocessing apparatus 40E is determined for each of the events, forexample, when the state determining unit 373 determines that the warningoccurrence state related to the CPU 71 and the error occurrence staterelated to the system fan simultaneously have occurred, the outputcontrol unit 474 causes the output unit 75 to change the lighting stateof the output unit 75, for example, according to rules R1) and R2)explained below.

R1) When the error occurrence state and the warning occurrence statesimultaneously occur, the lighting state of the output unit 75 ischanged to the lighting.

R2) When the error occurrence state does not occur and the warningoccurrence state occurs, the lighting state of the output unit 75 ischanged to the blinking.

Subsequently, the communication control unit 375 causes the externalcommunication unit 441 to output, to the information processingapparatus 5, information indicating a state code for identifying thestate of the image processing apparatus 40E determined by the statedetermining unit 373 in step S330 (step S350). In this way, the controlunit 37 repeats the processing of steps S310 to S350 to detect the eventindicating the abnormality of the image processing apparatus 40E andchange the lighting state of the output unit 75 according to thedetected event indicating the abnormality of the image processingapparatus 40E. Consequently, the control apparatus 30 can notify theuser of the state of the image processing apparatus 40E according to thelighting state of the output unit of the image processing apparatus 40E.The control unit 37 can notify the information processing apparatus 5 ofthe state of the image processing apparatus 40E by repeating theprocessing of steps S310 to S350.

Processing performed by the control apparatus 30 and the informationprocessing apparatus 5 after acquiring the information indicating thestate code output from the image processing apparatus 40E in step S350is explained. The control apparatus 30 records the state code foridentifying the state of the image processing apparatus 40E determinedby the state determining unit 373 in step S330 in an error historytogether with a message associated with a state code shown in FIG. 51.

FIG. 51 is a table showing an example of a correspondence relationbetween the state code for identifying the state of the image processingapparatus 40E determined by the state determining unit 373 in step S330and the message recorded in the error history together with the statecode.

In this way, the control apparatus 30 can record, as the error history,in which hardware or control of the image processing apparatus 40E theevent indicating the abnormality of the image processing apparatus 40Ehas occurred and reduce labor of the user related to maintenance,repairing, and the like of the image processing apparatus 40E. Note thatstate codes shown in FIG. 51 are only an example and may be othernumerical values, characters, and the like.

The control apparatus 30 may be configured to include, for example, adisplay unit W different from the output unit 35 such as a seven-segmentLED, cause the output control unit 374 to display a number representingthe state code on the display unit W, and notify the user that the eventindicating the abnormality of the image processing apparatus 40E hasoccurred. In this case, the control apparatus 30 can easily notify theuser in which hardware or control of the image processing apparatus 40Ethe event indicating the abnormality of the image processing apparatus40E has occurred.

The communication control unit 375 of the control apparatus 30 controlsthe communication unit 34 to output information indicating the statecode to the information processing apparatus 5. The informationprocessing apparatus 5 acquires the information indicating the statecode from the control apparatus 30 and causes, on the basis of theacquired state code, the image processing apparatus 40E to display, on adisplay (or a GUI displayed on the display), information indicating thatthe event indicating the abnormality has occurred in the imageprocessing apparatus 40E. Consequently, the information processingapparatus 5 can notify, via the GUI, the user in which hardware orcontrol of the image processing apparatus 40E the event indicating theabnormality of the image processing apparatus 40E has occurred. As aresult, it is possible to reduce labor of the user who has to directlyoperate the control apparatus 30 and the image processing apparatus 40E.

In the following explanation, processing performed between theinformation processing apparatus 5 and the control apparatus 30 afterthe image processing apparatus 40E is connected to the robot system 1(in this example, the control apparatus 30) is explained. After theimage processing apparatus 40E is connected to the control apparatus 30and the information processing apparatus 5 recognizes the imageprocessing apparatus 40E, the information processing apparatus 5cyclically (e.g., every time one second elapses) requests the controlapparatus 30 to acquire detection information acquired from the imageprocessing apparatus 40E. When acquiring the request, the controlapparatus 30 outputs, to the information processing apparatus 5,detection information acquired in the control apparatus 30 at a point intime when the request is acquired.

The information processing apparatus 5 acquires the detectioninformation from the control apparatus 30. The information processingapparatus 5 receives operation from the user via the GUI displayed onthe display and causes, on the basis of the received operation, thedisplay to display a GUI for displaying detection values included in theacquired detection information.

FIG. 52 is a diagram showing an example of the GUI for displaying thedetection values included in the detection information acquired from theimage processing apparatus 40E.

In this example, on the GUI, as shown in FIG. 52, a free capacity of thememory 421 (in FIG. 52, shown as a MB of a total capacity of b MB), afree capacity of the storage 422 (in FIG. 52, shown as c MB of a totalcapacity of d MB), the number of revolutions of the cooling fan for theCPU 71 (in FIG. 52, shown as e RPM), the temperature of the CPU 71 (inFIG. 52, shown as f ° C.), the number of revolutions of the system fanthat cools the inside of the housing of the image processing apparatus40E (in FIG. 52, shown as g RPM), and a voltage value of the battery forBIOS backup incorporated in the image processing apparatus 40E (in FIG.52, shown as h V) are displayed. Consequently, by causing the display ofthe information processing apparatus 5 to display the GUI shown in FIG.52, the user can check whether the event indicating the abnormality ofthe image processing apparatus 40E has occurred.

Note that the processing performed between the information processingapparatus 5 and the control apparatus 30 may be performed between thecontrol apparatus 30 and the image processing apparatus 40E, may beperformed between the information processing apparatus 5 and the imageprocessing apparatus 40E, or may be performed between the informationprocessing apparatus 5 and the image processing apparatus 40E andbetween the control apparatus 30 and the image processing apparatus 40E.

The image processing apparatus 40E is only an example of the processingapparatus in the aspect of the invention. The abnormal state notifyingfunction explained in this embodiment may be included in, for example, asound processing apparatus that processes sound data, an inputprocessing apparatus (e.g., a teaching pendant) that processes inputoperation received from the user and moves the robot 20 according to theinput operation, or a data processing apparatus that processes someother data.

The control apparatus 30 explained above is an example of the controllerin the aspect of the invention.

As explained above, the control apparatus 30 included in the robotsystem 1 in this embodiment acquires (receives), from the imageprocessing apparatus 40E that processes a picked-up image, the detectioninformation of the image processing apparatus 40E, determines the stateof the image processing apparatus 40E on the basis of the detectioninformation, and generates, on the basis of a result of thedetermination, a transmission signal to be transmitted to an externalapparatus (in this example, the information processing apparatus 5).Consequently, the control apparatus 30 makes it possible to notify thestate of the image processing apparatus.

The control apparatus 30 determines, as the state of the imageprocessing apparatus 40E, any one of a state in which the state of theimage processing apparatus 40E is normal, a state in which the imageprocessing apparatus 40E is highly lightly to be out of order, and astate in which the image processing apparatus 40E is highly likely tofail in future. Consequently, the control apparatus 30 makes it possibleto notify that the state of the image processing apparatus 40E is anyone of the normal state, the state in which the image processingapparatus 40E is highly likely to be out of order, and the state inwhich the image processing apparatus 40E is highly likely to fail infuture.

The control apparatus 30 detects the event indicating the abnormality ofthe image processing apparatus 40E on the basis of one or more physicalquantities indicating states of the hardware included in the imageprocessing apparatus 40E and determines the state of the imageprocessing apparatus 40E on the basis of the detected event.Consequently, the control apparatus 30 can generate a transmissionsignal based on the state of the image processing apparatus 40Edetermined on the basis of the event indicating the abnormality of theimage processing apparatus 40E.

The control apparatus 30 detects the event indicating the abnormality ofthe image processing apparatus 40E on the basis of an error code relatedto the control of the image processing apparatus 40E. Consequently, thecontrol apparatus 30 can generate a transmission signal based on thestate of the image processing apparatus 40E determined on the basis ofthe event indicating the abnormality of the image processing apparatus40E detected on the basis of the error code related to the control ofthe image processing apparatus 40E.

The control apparatus 30 associates, with the state of the imageprocessing apparatus 40E determined on the basis of the event indicatingthe abnormality of the image processing apparatus 40E, information foridentifying the state of the image processing apparatus 40E andincludes, in the transmission signal, the associated information foridentifying the state of the image processing apparatus 40E.Consequently, the control apparatus 30 can generate the transmissionsignal including the information for identifying the state of the imageprocessing apparatus 40E.

The control apparatus 30 causes the communication unit 34 to transmitthe transmission signal generated on the basis of the determinationresult of the state of the image processing apparatus 40E to theexternal apparatus. Consequently, the control apparatus 30 can notify auser of the external apparatus of the state of the image processingapparatus 40E.

The control apparatus 30 causes, according to a request from theexternal apparatus, the communication unit to transmit, to the externalapparatus, information indicating the one or more physical quantitiesindicating the states of the hardware included in the image processingapparatus 40E. Consequently, the control apparatus 30 can notify theuser of the one or more physical quantities indicating the states of thehardware included in the image processing apparatus 40E.

The control apparatus 30 causes, according to the determination resultof the state of the image processing apparatus 40E, the communicationunit 34 to transmit, to the image processing apparatus 40E, informationfor requesting a change of the lighting state of the output unitincluded in the image processing apparatus 40E.

Consequently, the control apparatus 30 can cause the user to check, withthe image processing apparatus 40E, the state of the image processingapparatus 40E.

The information processing apparatus 5 displays a GUI for displaying theone or more physical quantities indicating the states of the hardwareincluded in the image processing apparatus 40E acquired from the controlapparatus 30. Consequently, the information processing apparatus 5 canfacilitate the management of the state of the image processing apparatus40E by providing the user with the GUI for displaying the one or morephysical quantities indicating the states of the hardware included inthe image processing apparatus 40E.

Eighth Embodiment

An embodiment of the invention is explained below with reference to thedrawings. Note that components same as the components in the firstembodiment are denoted by the same reference numerals and signs andexplanation of the components is omitted or simplified.

In the following explanation, a program updating function of an imageprocessing apparatus 40F in the robot system 1 configured as shown inFIG. 1 is explained. In this embodiment, the program updating functionof the image processing apparatus 40F indicates, for example, a functionof changing (e.g., changing through rewriting or changing throughdeletion) a part or all of a plurality of computer programs forrealizing an OS and application software of the image processingapparatus 40F. However, the program updating function may be a functionof changing one or more other computer programs. In the followingexplanation, for convenience of explanation, changing (e.g., changingthrough rewriting or changing through deletion) a computer program isreferred to as updating the computer program and explained. Note that,in this embodiment, software is explained as a general term of afunction realized by executing the computer program.

The hardware configuration of the image processing apparatus 40F isexplained with reference to FIG. 53.

FIG. 53 is a diagram showing an example of the hardware configuration ofthe image processing apparatus 40F according to this embodiment. Theimage processing apparatus 40F includes, for example, the CPU 71, thestoring unit 72, the input receiving unit 43, the communication unit 74,a display unit 245, and the detecting unit 76 and performs communicationwith the control apparatus 30, other image processing apparatuses 40F,other apparatuses, and the like via the communication unit 74. Thesecomponents are communicably connected to one another via the bus Bus.The CPU 71 executes various computer programs stored in the storing unit72.

The storage 422 includes, for example, a HDD, an SSD, an EEPROM, a ROM,or a RAM and stores various kinds of computer programs including a firstcomputer program 4221, a second computer program 4222, and a thirdcomputer program 4223, various kinds of information to be processed bythe image processing apparatus 40F, and an image to be processed by theimage processing apparatus 40F.

A storage region of the storage 422 is divided into a plurality ofstorage regions by a partition. In this example, it is assumed that thefirst computer program 4221 and the second computer program 4222 arestored in a first storage region and the third computer program 4223 isstored in a second storage region different from the first storageregion. Note that, like the external storage 423, the memory 421 and thestorage 422 may be respectively external storage devices connected by,for example, a digital input/output port such as a USB instead ofstorage devices incorporated in the image processing apparatus 40F.

The first computer program 4221 indicates a computer program forrealizing software different from the second computer program 4222 andthe third computer program 4223 by being executed by the CPU 71. In thisexample, the first computer program 4221 indicates a computer programfor realizing an OS by being executed by the CPU 71. However, the firstcomputer program 4221 may be a computer program for realizing othersoftware. For example, the OS realized when the first computer program4221 is executed by the CPU is an OS built on the basis of LINUX(registered trademark). However, the OS may be other OSs such as UNIX(registered trademark). In the following explanation, for convenience ofexplanation, the OS is referred to as normal time start OS andexplained. Update of the first computer program 4221 is referred to asupdate of the normal time start OS and explained.

The second computer program 4222 indicates a computer program forrealizing software different from the first computer program 4221 andthe third computer program 4223 by being executed by the CPU 71. In thisexample, the second computer program 4222 indicates one or more computerprograms for realizing application software operating on the normal timestart OS.

The third computer program 4223 indicates a computer program forrealizing software different from the first computer program 4221 andthe second computer program 4222 by being executed by the CPU 71. Inthis example, the third computer program 4223 indicates a computerprogram for realizing an OS by being executed by the CPU 71. However,the third computer program 4223 may be a computer program for realizingother software. For example, the OS realized when the third computerprogram 4223 is executed by the CPU 71 is an OS started, for example,when the normal time start OS cannot be started because of some reasonor when a part or the entire first computer program 4221 is updated. TheOS realized when the third computer program 4223 is executed by the CPU71 is an OS built on the basis of LINUX (registered trademark). However,the OS may be other OSs. In the following explanation, for convenienceof explanation, the OS is referred to as failure time start OS andexplained.

The external storage 423 is, for example, an external storage deviceconnected by, for example, a digital input/output port such as a USB.The external storage 423 stores an update file 4231 and the like. Notethat the external storage 423 is an example of the external storagedevice.

The update file 4231 is a program file for updating the normal timestart OS (i.e., the first computer program 4221). In this example, theupdate file 4231 is an image file based on a standard such as ext3(third extended file system) or iso9660 and includes an installer andupdate data of the normal time start OS.

The installer is a compressed file with a password and includes a normaltime start OS update program for updating the normal time start OS. Thenormal time start OS update program included in the installer isexecuted by the failure time start OS to perform update of the normaltime start OS using the update data of the normal time start OS. Notethat a form of the update data of the normal time start OS may be anyform as long as the form is a form corresponding to the update programof the normal time start OS.

For example, content of update by the update program of the normal timestart OS is postscript of a text according to a command by a shellscript, the update data of the normal time start OS does not have to beincluded (present) in the external storage 423. When the content of theupdate by the update program of the normal time start OS is copying of aplurality of data files to a specific directory, the update data of thenormal time start OS includes the plurality of data files.

The update file 4231 is explained with reference to FIG. 54.

FIG. 54 is a diagram illustrating a plurality of files stored in theexternal storage 423. As shown in FIG. 54, the update file 4231 isincluded in the external storage 423. In this example, in the externalstorage 423, as shown in FIG. 54, in addition to the update file 4231, achecksum file of the update file 4231, a release note file, and an enduser license agreement (EULA) file are included. However, a part or allof these files do not have to be included in the external storage 423.The checksum file is a program file for checking, by being executed bythe failure time start OS, whether the update file 4231 is normal. Notethat the update file 4231 is an example of the first data in the aspectof the invention.

The input receiving unit 43 is, for example, a built-in or externalkeyboard or a mouse. However, the input receiving unit 43 may be a touchpad or other input devices instead of the keyboard or the mouse. In thecase of the touch pad, the input receiving unit 43 may be configuredintegrally with the display unit 245 as a touch panel. In this example,the input receiving unit 43 is explained as the external keyboard.

The communication unit 74 includes the external communication unit 441,the first image-pickup communication unit 442, and the secondimage-pickup communication unit 443.

The external communication unit 441 includes, for example, digitalinput/output ports such as a plurality of Ethernet (registeredtrademark) ports or a plurality of USBs. In the explanation of thisexample, it is assumed that the external communication unit 441 includestwo Ethernet (registered trademark) ports.

The first image-pickup communication unit 442 includes digitalinput/output ports such as a plurality of Ethernet (registeredtrademark) ports or a plurality of USBs. The ports are dedicated portsfor performing communication with the image pickup apparatus 10. Notethat the first image-pickup communication unit 442 may be a dedicatedport for performing communication with other apparatuses such as a soundacquiring apparatus for acquiring sound.

The second image-pickup communication unit 443 includes digitalinput/output ports such as a plurality of Ethernet (registeredtrademark) ports or a plurality of USBs. The ports are dedicated portsfor performing communication with the image pickup apparatus 10. Notethat the second image-pickup communication unit 443 may be a dedicatedport for performing communication with other apparatuses such as a soundacquiring apparatus for acquiring sound.

The first image-pickup communication unit 442 and the secondimage-pickup communication unit 443 are different in communicationstandards of the ports thereof. In this example, it is assumed that thefirst image-pickup communication unit 442 includes four Ethernet(registered trademark) ports and the second image-pickup communicationunit 443 includes four USB ports.

The display unit 245 is, for example, an external liquid crystal displaypanel or an organic EL display panel. However, instead, the display unit245 may be a built-in liquid crystal display panel or organic EL displaypanel.

The detecting unit 76 is a plurality of sensors for detecting physicalquantities serving as indexes indicating states of a respectiveplurality of pieces of hardware included in the image processingapparatus 40F. In this example, the plurality of pieces of hardwareincluded in the image processing apparatus 40F indicate a not-showncooling fan for the CPU 71, a not-shown system fan that cools the insideof a housing of the image processing apparatus 40F, the CPU 71, and anot-shown battery for BIOS backup incorporated in the image processingapparatus 40F. However, the plurality of pieces of hardware may be otherpieces of hardware.

The functional configuration of the image processing apparatus 40Fduring the start of the normal time start OS is explained with referenceto FIG. 55.

FIG. 55 is a diagram showing an example of the functional configurationof the image processing apparatus 40F during the start of the normaltime start OS. The image processing apparatus 40F includes the storingunit 72, the communication unit 74, the display unit 245, a detectingunit 76, and a control unit 77-1. A part or all of functional unitsincluded in the control unit 77-1 are realized by, for example, the CPU71 executing the first computer program 4221 and the second computerprogram 4222 stored in the storing unit 72.

A part of the functional units may be hardware functional units such asan LSI and an ASIC. Note that, in the explanation of this example, it isassumed that the image pickup apparatus 10 is connected to the firstimage-pickup communication unit 442 and an image pickup apparatus is notconnected to the second image-pickup communication unit 443.

The control unit 77-1 controls the entire image processing apparatus40F. The control unit 77-1 includes an application updating unit 270, acommunication control unit 771, an image-pickup control unit 772, animage acquiring unit 273, and an image processing unit 274.

When acquiring, from the information processing apparatus 5 via theexternal communication unit 441, a request for update of applicationsoftware realized when a part or all of one or more computer programsincluded in the second computer program 4222 are executed by the CPU 71,the application updating unit 270 performs, according to the request,application update processing for updating a part or all of the one ormore computer programs included in the second computer program 4222.Note that the application updating unit 270 is an example of the secondupdating unit.

The communication control unit 771 outputs information concerning aposition and a posture of the work target M calculated by the imageprocessing unit 274 to the control apparatus 30.

The image-pickup control unit 772 controls, via the first image-pickupcommunication unit 442, the image pickup apparatus 10 to pick up animage of a range including the work target M. When some image pickupapparatus Z is connected to the second image-pickup communication unit443, the image-pickup control unit 772 controls, via the secondimage-pickup communication unit 443, the image pickup apparatus Z topick up an image of a range in which the image pickup apparatus Z canpick up an image.

The image acquiring unit 273 acquires a picked-up image from the imagepickup apparatus 10 via the first image-pickup communication unit 442.When the image pickup apparatus Z is connected to the secondimage-pickup communication unit 443, the image acquiring unit 273acquires a picked-up image from the image pickup apparatus Z via thesecond image-pickup communication unit 443.

The image processing unit 274 performs, on the basis of the picked-upimage acquired by the image acquiring unit 273, image processing forcalculating a position and a posture of the work target M. Note that theimage processing unit 274 is an example of the processing unit in theaspect of the invention.

The functional configuration of the image processing apparatus 40Fduring the start of the failure time start OS is explained withreference to FIG. 56.

FIG. 56 is a diagram showing an example of the functional configurationof the image processing apparatus 40F during the start of the failuretime start OS. The image processing apparatus 40F includes the storingunit 72, the communication unit 74, the display unit 245, the detectingunit 76, and a control unit 77-2. A part or all of functional unitsincluded in the control unit 77-2 are realized by, for example, the CPU71 executing the third computer program 4223 stored in the storing unit72. A part of the functional units may be hardware functional units suchas an LSI and an ASIC.

The control unit 77-2 controls the entire image processing apparatus40F. The control unit 77-2 includes a file checking unit 275, an OSupdating unit 276, and a display control unit 777.

When execution of OS update processing for updating the normal timestart OS is selected by a user via a GUI that the display control unit777 causes the display unit 245 to display, the file checking unit 275confirms that the update file 4231 is stored in the external storage 423connected to the image processing apparatus 40F (determines whether theupdate file 4231 is stored).

When the file checking unit 275 confirms that the update file 4231 isstored in the external storage 423 (determines that the update file 4231is stored), the OS updating unit 276 updates the first computer program4221 (i.e., performs the OS update processing) on the basis of theupdate file 4231 stored in the external storage 423. Note that the OSupdating unit 276 is an example of the first updating unit.

The display control unit 777 controls the display unit 245 to display aCUI (Command User Interface) or a GUI related to the operation of thefailure time start OS. In the explanation of this example, it is assumedthat the display control unit 777 controls the display unit 245 todisplay the CUI.

In the following explanation, application update processing performed bythe control unit 77-1 is explained with reference to FIG. 57.

FIG. 57 is a flowchart for explaining an example of a flow of theapplication update processing performed by the control unit 77-1. In thefollowing explanation, processing performed after the control unit 77-1acquires, from the information processing apparatus 5 via the externalcommunication unit 441, a request for update of application softwarerealized when a part or all of one or more computer programs included inthe second computer program 4222 are executed by the CPU 71 isexplained.

First, the application updating unit 270 acquires, from the informationprocessing apparatus 5, a file for update necessary for updating a partor all of the one or more computer programs included in the secondcomputer program 4222. In the following explanation, for convenience ofexplanation, the file for update is referred to as file for applicationupdate and explained. The application updating unit 270 performs, on thebasis of the acquired file for application update, update of a part orall of the one or more computer programs included in the second computerprogram 4222 (step S410). In the following explanation, for convenienceof explanation, the update of a part or all of the one or more computerprograms included in the second computer program 4222 is simply referredto as update of the second computer program 4222 and explained. Notethat the file for application update is an example of the second data inthe aspect of the invention.

Subsequently, the application updating unit 270 determines whether theupdate of the second computer program 4222 performed in step S410 issuccessful (step S420). When it is determined that the update of thesecond computer program 4222 is successful (Yes in step S420), thecommunication control unit 771 transmits information indicating thesuccess of the update of the second computer program 4222 to theinformation processing apparatus 5 via the external communication unit441 (step S430). On the other hand, when it is determined that theupdate of the second computer program 4222 is unsuccessful (No in stepS420), the communication control unit 771 transmits informationindicating an error of the update of the second computer program 4222 tothe information processing apparatus 5 via the external communicationunit 441 (step S440).

In the following explanation, OS update processing performed by thecontrol unit 77-2 is explained with reference to FIG. 58.

FIG. 58 is a flowchart for explaining an example of a flow of the OSupdate processing performed by the control unit 77-2. In the followingexplanation, processing performed after the failure time start OS isstarted in the image processing apparatus 40F is explained. First, thedisplay control unit 777 controls the display unit 245 to display a CUIfor displaying a menu of the failure time start OS (step S510).

The CUI for displaying the menu of the failure time start OS isexplained with reference to FIG. 59.

FIG. 59 is a diagram showing an example of the CUI for displaying themenu of the failure time start OS. On the CUI, for example, a menuindicating five selectable operations of the failure time start OS isdisplayed as shown in FIG. 59. In this example, the five selectableoperations are respectively operations explained below. Note that thefive operations explained below are respectively Japanese versions ofthe five operations displayed on the CUI shown in FIG. 59.

1. Reset (initialization) of setting of xxx

2. Reset (initialization) of setting of yyy

3. Update of the normal time start OS

9. Start of Shell

0. End the failure time start OS and restart the normal time start OS

In this example, the “setting of xxx” indicates setting of the imageprocessing performed by the image processing unit 274 but may be othersettings. The “setting of yyy” indicates setting of the image processingapparatus 40F but may be other settings. The image processing apparatus40F receives, with the input receiving unit 43, via the CUI shown inFIG. 59, a number (any one of 1 to 3, 9, and 0 described above)indicating a desired operation from the user to perform the operationindicated by the received number. In FIG. 59, a state in which “3.Update of the normal time start OS” is selected is shown.

Subsequently, the control unit 77-2 receives, with the input receivingunit 43, via the CUI displayed in step S510, a number indicating adesired operation from the user (step S520). In the followingexplanation, it is assumed that the user selects “3. Update of thenormal time start OS” in step S520. When the user selects “3. Update ofthe normal time start OS” in step S520, the display control unit 777controls the display unit 245 to display a CUI shown in FIG. 60.

FIG. 60 shows an example of a CUI for displaying a warning to an eventthat occurs when the update of the normal time start OS is executed andchecking whether the update of the normal time start OS is executed. Inthis example, the execution of the update of the normal time start OScauses an event that all data are erased as displayed in the warningshown in FIG. 60. However, instead, the execution of the update of thenormal time start OS may cause other events, for example, erasing of apart of the data. In the following explanation, it is assumed that, instep S520, the control unit 77-2 receives, with the input receiving unit43, from the user, operation for accepting the execution of the updateof the normal time start OS (in this example, operation for inputting“yes”).

When, in step S520, the control unit 77-2 receives, with the inputreceiving unit 43, from the user, the operation for accepting theexecution of the update of the normal time start OS, the file checkingunit 275 determines (checks) whether the update file 4231 is stored inthe external storage 423 connected to the image processing apparatus 40F(step S530). When the file checking unit 275 determines that the updatefile 4231 is not stored in the external storage 423 (No in step S530),the display control unit 777 controls the display unit 245 to display aCUI for displaying information indicating an error (step S550). On theother hand, when the file checking unit 275 determines that the updatefile 4231 is stored in the external storage 423 (Yes in step S530), theOS updating unit 276 performs OS update processing for updating thenormal time start OS (step S540).

The OS update processing for updating the normal time start OS isexplained. The OS updating unit 276 executes a checksum file stored inthe external storage 423 and determines (checks) whether the update file4231 is normal. When it is determined by the checksum file that theupdate file 4231 is not normal, the OS updating unit 276 determines thatthe update file 4231 is an unauthorized update file and determines indetermination in step S560 that the update of the normal time start OSis successful.

On the other hand, when it is determined by the checksum file that theupdate file 4231 is normal, the OS updating unit 276 mounts the updatefile 4231, for example, on a predetermined mount point (directory). Whenthe update file 4231 cannot be mounted on the mount point, the OSupdating unit 276 determines that the update file 4231 is anunauthorized update file and determines in the determination in stepS560 that the update of the normal time start OS is unsuccessful.

On the other hand, when the update file 4231 is mounted on the mountpoint, the OS updating unit 276 decompresses, using a password stored inadvance in the failure time start OS, in the external storage 423, theinstaller included in the update file 4231 stored in the externalstorage 423. When the decompression of the installer performed using thepassword stored in advance in the failure time start OS is unsuccessful,the OS updating unit 276 determines that the update file 4231 is anunauthorized update file and determines in the determination in stepS560 that the update of the normal time start OS is unsuccessful.

On the other hand, when the decompression of the installer performedusing the password stored in advance in the failure time start OS issuccessful, the OS updating unit 276 executes a decompressed updateprogram for the normal time start OS and executes update of the normaltime start OS on the basis of update data of normal time start OS. Whenexecuting the update of the normal time start OS, the OS updating unit276 backs up the normal time start OS before the update in a storageregion of the external storage 423. Consequently, when the normal timestart OS is damaged because of some reason during the execution of theupdate of the normal time start OS, the OS updating unit 276 can restorethe normal time start OS using the normal time start OS backed up in theexternal storage 423.

Subsequently, the OS updating unit 276 determines whether the update ofthe normal time start OS performed in step S540 is successful (stepS560). When it is determined that the update of the normal time start OSis not successful (unsuccessful), the display control unit 777 controlsthe display unit 245 to display information indicating an error (stepS580) and ends the processing. On the other hand, when it is determinedthat the update of the normal time start OS is successful, the displaycontrol unit 777 controls the display unit 245 to display a CUI fordisplaying information indicating the success of the update of thenormal time start OS as shown in FIG. 61 (step S580) and ends theprocessing.

FIG. 61 is a diagram showing an example of the CUI for displaying theinformation indicating the success of the update of the normal timestart OS.

In this way, the image processing apparatus 40F performs the update ofthe normal time start OS using the external storage 423. Therefore, evenwhen a free capacity of the storage 422 is small, it is possible toperform the processing related to the update of the normal time start OSirrespective of the free capacity of the storage 422, for example, backup the normal time start OS before the update in the external storage423.

The image processing apparatus 40F performs the update of the normaltime start OS using the external storage 423. Therefore, for example,even when the image processing apparatus 40F is connected in a closednetwork like a factory, the image processing apparatus 40F can easilyperform the update of the normal time start OS.

As explained above, the image processing apparatus 40F can easilyperform the update of the normal time start OS. Therefore, the imageprocessing apparatus 40F can quickly perform a complementary treatmentfor a fatal deficiency and vulnerability due to the normal time startOS. The image processing apparatus 40F can perform, for example,application update processing for improving functions and performance ofapplication software related to image processing.

As explained above, in the image processing apparatus 40F included inthe robot system 1 in this embodiment, the first computer program 4221is updated using the update file 4231 stored in the external storage423. The second computer program 4222 is updated using the file forapplication update stored in the information processing apparatus 5.Consequently, the image processing apparatus 40F can easily update acomputer program.

The image processing apparatus 40F operates according to the executionof the third computer program 4223 different from the first computerprogram 4221 and the second computer program 4222, reads the update file4231 stored in the external storage 423, and updates the first computerprogram 4221 on the basis of the read update file 4231. Consequently,the image processing apparatus 40F can update the first computer program4221 without executing the first computer program 4221. Therefore, theimage processing apparatus 40F can suppress the first computer program4221 from being damaged by the update of the first computer program 4221performed during the execution of the first computer program 4221.

The image processing apparatus 40F backs up the first computer program4221 before the update in the storage region of the external storage 423and thereafter updates the first computer program 4221 on the basis ofthe update file 4231. Consequently, the image processing apparatus 40Fdoes not need to secure a storage region for backup in a storage regionof the image processing apparatus 40F. It is possible to reduce costsfor securing the storage region of the image processing apparatus 40F.

The image processing apparatus 40F determines whether the update file4231 is stored in the external storage 423. When it is determined thatthe update file 4231 is not stored in the external storage 423, theimage processing apparatus 40F causes the display unit 245 to displayinformation indicating an error. When it is determined that the updatefile 4231 is stored in the external storage 423, the image processingapparatus 40F updates the first computer program 4221 on the basis ofthe update file 4231. Consequently, the image processing apparatus 40Fcan suppress the update of the first computer program 4221 from beingcontinued by mistake in a state in which the update file 4231 is notstored in the external storage 423.

The image processing apparatus 40F operates according to the executionof the first computer program 4221, acquires the file for applicationupdate from the information processing apparatus 5 via the externalcommunication unit 441, and updates the second computer program 4222 onthe basis of the acquired file for application update. Consequently, theimage processing apparatus 40F can easily update the second computerprogram 4222 with the information processing apparatus 5.

The embodiments of the invention are explained in detail above withreference to the drawings. However, specific components are not limitedto the embodiments and may be, for example, changed, substituted, anddeleted without departing from the spirit of the invention.

A computer program for realizing the functions of any components in theapparatuses explained above (e.g., the information processing apparatus5, the control apparatus 30, and the image processing apparatuses 40F,40-1 to 40-3, and 40D) may be recorded in a computer-readable recordingmedium, read by a computer system, and executed. Note that the “computersystem” includes an OS and hardware such as peripheral apparatuses. The“computer-readable recording medium” refers to a portable medium such asa flexible disk, a magneto-optical disk, a ROM, or a CD (CompactDisk)-ROM or a storage device such as a hard disk incorporated in thecomputer system. Further, the “computer-readable recording medium”includes a recording medium that retains a computer program for a fixedtime like a volatile memory (a RAM) in a computer system functioning asa server or a client when the computer program is transmitted via anetwork such as the Internet or a communication line such as a telephoneline.

The computer program may be transmitted from the computer system, inwhich the computer program is stored in the storage device or the like,to other computer systems via a transmission medium or a transmissionwave in the transmission medium. The “transmission medium” fortransmitting the computer program refers to a medium having a functionof transmitting information like a network (a communication network)such as the Internet or a communication line (a communication wire) suchas a telephone line.

The computer program may be a computer program for realizing a part ofthe functions explained above. Further, the computer program may be acomputer program that can realize the functions in a combination with acomputer program already recorded in the computer system, a so-calleddifferential file (a differential program).

What is claimed is:
 1. A controller comprising: a processor configuredto execute computer-readable instructions stored in a memory so as to:receive status information of an image processing device that processesa captured image; determine a status of the image processing devicebased on the status information; and generate a transmission signal thatis transmitted to an external apparatus based on the determined statusof the image processing device.
 2. The controller according to claim 1,wherein the determined status includes: a normal status that correspondsto a state in which the image processing device has no failure; adefective status that corresponds to a state in which the imageprocessing device has a failure; and a possible defective status thatcorresponds to a state in which the image processing device has a highpossibility of the failure.
 3. The controller according to claim 2,wherein the status information includes a plurality of physical valuesthat correspond to statuses of a plurality of hardware components in theimage processing device, and the processor is configured to determine aphenomenon based on each of the plurality of physical values, and thephenomenon corresponds to the status of the image processing device. 4.The controller according to claim 3, wherein the plurality of physicalvalues include an error code, and the error code corresponds to acontrol of the image processing device, and the processor is configuredto determine the phenomenon based on the error code.
 5. The controlleraccording to claim 4, wherein the processor is configured to associatethe status of the image processing device with an identifier, and theprocessor is configured to place the identifier into the transmissionsignal.
 6. The controller according to claim 3, wherein the processor isconfigured to cause the external apparatus to transmit the statusinformation including the plurality of physical values based on anrequest from the external apparatus.
 7. The controller according toclaim 5, wherein the processor is configured to cause the imageprocessing device to transmit request information to change an outputstatus of the image processing device based on the determined status ofthe image processing device.
 8. An information processing apparatuscomprising: a display that displays a physical value that indicates astatus of a plurality of hardware components in an image processingdevice; and a processor that is configured to receive status informationincluding a plurality of physical values that correspond to statuses ofa plurality of hardware components in the image processing device basedon a phenomenon that is determined according to the plurality ofphysical values.
 9. A robot system comprising: a robot that isconfigured to perform a task; a camera that is configured to capture animage of an area where the robot performs the task; an image processingdevice that is configured to process the image so as to output a result;and a controller that is configured to control the robot based on theresult from the image processing device, wherein the controller includesa processer that is configured to execute computer-readable instructionsstored in a memory so as to: receive status information of the imageprocessing device; determine a status of the image processing devicebased on the status information; and generate a transmission signal thatis transmitted to an external apparatus based on the determined statusof the image processing device.